-- Logs begin at Tue 2022-05-10 15:56:42 UTC, end at Tue 2022-05-10 17:08:56 UTC. -- May 10 16:38:54.627197 dv-cinder-835881-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 16:38:54.636595 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 16:38:54 2022] *** May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: nodename: dv-cinder-835881-10-iscsi May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: machine: x86_64 May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: clock source: unix May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: pcre jit disabled May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: detected number of CPU cores: 4 May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: current working directory: / May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: detected binary path: /usr/bin/uwsgi-core May 10 16:38:54.638576 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: your processes number limit is 47680 May 10 16:38:54.639334 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: your memory page size is 4096 bytes May 10 16:38:54.639334 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: detected max file descriptor number: 2048 May 10 16:38:54.639334 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: lock engine: pthread robust mutexes May 10 16:38:54.639334 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: thunder lock: enabled May 10 16:38:54.639334 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 16:38:54.639334 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 16:38:54.685225 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: Python main interpreter initialized at 0x562ff6b1f9c0 May 10 16:38:54.685225 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: python threads support enabled May 10 16:38:54.685225 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: your server socket listen backlog is limited to 100 connections May 10 16:38:54.685225 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: your mercy for graceful operations on workers is 90 seconds May 10 16:38:54.685592 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: mapped 403077 bytes (393 KB) for 2 cores May 10 16:38:54.685669 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: *** Operational MODE: preforking *** May 10 16:38:54.685888 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: *** uWSGI is running in multiple interpreter mode *** May 10 16:38:54.685888 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: spawned uWSGI master process (pid: 119842) May 10 16:38:54.686073 dv-cinder-835881-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 16:38:54.687097 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: spawned uWSGI worker 1 (pid: 119843, cores: 1) May 10 16:38:54.687414 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: spawned uWSGI worker 2 (pid: 119844, cores: 1) May 10 16:38:54.687587 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 16:38:55.875427 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 16:38:55.933017 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 16:38:56.608544 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:38:56.608544 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: from cryptography.utils import int_from_bytes May 10 16:38:56.608871 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:38:56.608871 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: from cryptography.utils import int_from_bytes May 10 16:38:56.647060 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:38:56.647060 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: from cryptography.utils import int_from_bytes May 10 16:38:56.647396 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:38:56.647396 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: from cryptography.utils import int_from_bytes May 10 16:38:59.191770 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:38:59.192367 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:38:59.192599 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:38:59.192964 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:38:59.193221 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:38:59.193606 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.193930 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.194062 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:38:59.194413 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.194503 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:38:59.194572 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.194840 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:38:59.194952 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.195168 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.195254 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:38:59.195454 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:38:59.195539 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.195791 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.195883 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.196117 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.196212 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.196402 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.196546 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.196718 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.196872 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.197040 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-10-iscsi {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.197207 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.197361 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.197522 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.197669 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.197847 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.197977 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.198172 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.198293 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.198504 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.198597 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.198772 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.198906 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.199092 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.199211 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.199421 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-10-iscsi {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.199704 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.199815 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.200055 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.200174 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.200409 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.200525 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.200734 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.200862 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.201045 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.201158 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.201374 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.201471 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.201680 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.201771 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.201999 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.202185 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.202294 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.202502 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.202619 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.202815 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.202927 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.203129 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.203326 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-10-iscsi {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.203472 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.203639 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.203792 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.203943 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.204107 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.204248 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.204460 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.204685 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.204793 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.204998 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.205082 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.205305 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.205395 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.206177 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.206355 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-10-iscsi {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.206528 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.206839 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.206969 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.207167 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.207260 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.207487 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.207588 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.207807 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.207893 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.208125 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.208219 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.208453 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.208554 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.208762 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.208846 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.209068 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.209183 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.209385 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.209501 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.209689 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.209843 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.209993 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.210171 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.210257 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.210501 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.210588 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.210828 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.210914 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.211137 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.211237 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.211455 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.211543 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.211767 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.211854 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.212048 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.212227 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.212403 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.212726 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.212857 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.213035 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.213325 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.213474 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.213634 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.213776 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.213940 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.214247 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.214343 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.214550 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.214854 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.214938 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.215156 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.215474 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.215569 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.215785 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.216104 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.216187 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.216435 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.216611 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.216757 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.217087 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.217178 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.217388 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.217694 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.217787 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.218029 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.218301 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.218397 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.218639 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.218884 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.218979 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.219263 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.219472 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.219557 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.219859 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.220077 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.220163 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.220492 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.220688 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.220816 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.221120 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.221865 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.221979 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.222220 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.222455 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.222553 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.222830 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.222977 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.223137 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.223441 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.223657 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.223798 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.223927 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.224029 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.224283 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.224372 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.224628 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.224750 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.224931 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.225081 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.225233 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.225420 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.225537 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.225838 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.225933 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.226103 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.226188 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.226426 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.226512 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.226725 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.226824 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.227043 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.227132 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.227362 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.227456 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.227668 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.227764 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.227972 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.228057 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.228323 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.228427 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.228601 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.228696 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.228917 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.229013 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.229220 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.229312 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.229523 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.229628 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.229844 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.229930 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.230148 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.230232 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.230447 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.230540 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.230759 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.230850 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.231062 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.231146 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.231364 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.231450 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.231680 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.231765 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.231980 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.232080 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.232296 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.232383 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.232619 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.232705 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.232922 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.233057 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.233226 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.233320 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.233526 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.233621 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.233826 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.233911 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.234128 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.234215 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.234429 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.234523 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.234728 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.234826 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.235028 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.235116 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.235324 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.235408 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.235639 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.235735 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.235960 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.236056 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.236283 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.236383 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.236598 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.236760 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.236935 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.237259 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.237386 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.237494 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.237648 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.237744 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.237967 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.238052 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.238298 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.238393 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.238610 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.238709 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.238919 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.239003 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.239245 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.239330 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.239558 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.239652 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.239865 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.239948 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.240177 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.240262 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.240531 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.240628 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.240846 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.240931 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.241156 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.241250 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.241467 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.241562 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.241785 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.241871 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.242093 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.242176 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.242402 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.242490 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.242712 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.242799 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.243022 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.243160 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.243331 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.243417 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.243635 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.243718 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.243939 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.244031 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.244261 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.244369 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.244604 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.244703 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.244913 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.245013 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.245225 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.245309 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.245537 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.245623 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.245865 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:38:59.245959 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.246187 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.246278 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.246506 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.246601 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.246813 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.246909 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.247120 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.247205 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.247427 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.247511 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.247746 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.247842 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.248075 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.248161 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.248413 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.248503 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.248729 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.248826 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.249038 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.249124 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.249346 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.249431 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.249652 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.249743 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.249959 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.250045 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.250266 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.250350 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.250598 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.250685 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.250910 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.251007 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.251221 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.251306 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.251530 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.251617 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.251844 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.251931 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.252160 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.252253 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.252524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.252680 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.252833 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.252935 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.253187 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.253338 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.253423 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.253515 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.253728 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.253814 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.254034 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.254154 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.254334 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.254475 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.254651 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.254805 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.254975 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.255132 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.255278 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.255450 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.255607 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.255767 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.255912 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.256083 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.256219 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.256435 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.256624 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.256775 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.256871 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.257093 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.257179 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.257416 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.257501 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.257726 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.257820 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.258030 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.258117 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.258342 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.258428 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.258646 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.258808 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.258949 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.259036 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.259269 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.259354 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.259571 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.259670 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.259873 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.259959 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.260185 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.260288 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.260519 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.260607 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.260828 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.260921 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.261136 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.261230 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.261441 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.261535 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.261750 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.261843 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.262060 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.262146 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.262373 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.262460 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.262687 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.262775 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.262997 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.263083 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.263307 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.263400 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.263629 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.263715 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.263937 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.264029 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.264255 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.264423 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.264583 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.264715 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.264891 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.265030 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.265195 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.265330 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.265498 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.265594 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.265801 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.265895 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.266108 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.266202 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.266413 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.266498 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.266718 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.266812 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.267020 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.267116 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.267322 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.267415 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.267627 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.267721 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.267949 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.268642 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.268778 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.268871 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.269198 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.269333 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.269468 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.269602 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.269784 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.269921 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.270102 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.270243 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.270425 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.270569 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.270742 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.270878 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.271070 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.271208 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.271388 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.271523 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.271706 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.271850 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.272023 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.272157 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.272364 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.272513 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.272681 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.272830 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.272993 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.273130 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.273306 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.273458 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.273617 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.273759 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.273927 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.274056 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.274240 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.274374 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.274544 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.274653 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.274853 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.274942 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.275160 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.275248 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.275473 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.275568 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.275776 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.275862 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.276086 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.276176 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.276416 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.276521 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.276725 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.276813 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.277034 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.277131 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.277361 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.277450 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.277674 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.277763 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.277986 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.278094 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.278294 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.278391 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.278600 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.278686 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.278912 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.279006 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.279223 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.279313 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.279532 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.279621 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.279851 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.279947 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.280159 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.280248 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.280502 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.280589 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.280813 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.280912 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.281135 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.281223 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.281443 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.281531 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.281760 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.281860 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.282064 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.282151 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.282376 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.282464 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.282699 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.282795 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.283016 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.283130 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.283325 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.283414 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.283635 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.283759 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.284738 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.284841 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.284926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.285078 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.285247 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.285409 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.285546 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.285695 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.285782 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.286002 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.286099 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.286309 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.286430 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.286622 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.286753 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.286937 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.287082 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.287246 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.287401 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.287556 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.287720 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.287860 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.288039 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.288158 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.288379 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.288477 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.288696 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.288882 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.289015 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.289118 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.289339 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.289425 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.289653 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.289750 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.289976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.290062 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.290291 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.290377 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.290610 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.290709 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.290916 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.291002 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.291220 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.291305 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.291530 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.291623 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.291836 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.291921 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.292137 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.292224 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.292466 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.292560 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.292771 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.292858 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.293112 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.293195 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.293420 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.293505 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.293724 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.293809 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.294037 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.294123 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.294347 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.294432 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.294652 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.294737 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.294959 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.295044 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.295268 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.295353 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.295575 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.295662 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.295888 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.295984 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.296197 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.296563 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.296790 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.296884 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.297099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.297194 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.297407 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.297493 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.297713 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.297804 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.298019 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.298127 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.298335 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.298433 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.298636 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.298720 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.298944 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.299039 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.299249 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.299382 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.299766 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.299979 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.300072 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.300155 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.300392 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.300483 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.300723 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.301003 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.301098 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.301334 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.301427 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.301643 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.301731 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.301951 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.302046 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.302267 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.302352 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.302584 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.302670 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.302899 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.302992 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.303219 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.303306 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.303545 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.303632 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.303848 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.303941 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.304156 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.304243 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.304486 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.304574 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.304897 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.304991 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.305211 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.305411 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.305507 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.305807 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.305969 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.306110 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.306419 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.306535 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.306723 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.307025 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.307109 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.307325 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.307628 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.307712 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.307939 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.308238 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.308345 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.308575 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.308874 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.308968 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.309195 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.309482 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.309567 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.309787 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.310087 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.310173 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.310387 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.310686 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.310781 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.311013 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.311277 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.311363 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.311662 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.311874 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.312002 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.312329 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.312528 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.312636 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.312960 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.313125 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.313269 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.313572 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.313876 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.314170 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.314257 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.314477 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.314775 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.314959 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.315177 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.315325 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.315718 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.315876 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.315967 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.316141 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.316227 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.316507 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.316594 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.316859 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.316959 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.317166 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.317253 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.317483 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.317570 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.317795 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.317896 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.318098 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.318187 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.318402 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.318501 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.318709 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.318813 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.319004 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.319092 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.319304 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.319399 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.319613 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.319712 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.319915 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.320001 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.320228 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.320367 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.320555 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.320644 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.320857 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.320950 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.321161 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.321249 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.321468 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.321557 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.321776 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.321875 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.322080 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.322167 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.322402 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.322490 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.322710 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.322804 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.323017 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.323103 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.323320 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.323416 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.323628 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.323714 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.323930 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.324027 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.324233 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.324339 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.324563 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.324649 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.324888 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.324986 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.325201 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.325288 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.325505 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.325592 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.325815 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.325957 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.326121 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.326230 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.326424 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.326514 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.326726 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.326824 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.327033 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.327121 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.327332 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.327430 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.327632 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.327721 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.327930 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.328016 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.328229 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.328337 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.328554 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.328671 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.328877 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.328987 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.329184 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.329281 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.329487 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.329577 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.329789 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.329877 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.330090 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.330187 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.330400 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.330487 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.331271 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.331748 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.331748 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.331923 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.332013 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.332103 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.332301 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.332394 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.332616 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.332724 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.332928 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.333016 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.333238 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.333325 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.333547 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.333644 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.333848 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.333934 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.334154 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.334240 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.334459 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.334554 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.334769 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.334856 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.335068 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.335154 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.335370 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.335459 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.335681 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.335775 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.335990 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.336078 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.336310 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.336402 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.336638 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.336735 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.336951 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.337039 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.337262 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.337351 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.337561 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.337647 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.337869 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.337957 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.338172 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.338259 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.338474 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.338567 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.338781 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.338894 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.339088 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.339194 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.339395 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.339484 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.339702 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.339797 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.340006 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.340094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.340330 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.340420 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.340640 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.340740 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.340944 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.341033 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.341250 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.341347 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.341553 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.341658 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.341853 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.341939 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.342157 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.342252 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.342465 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.342554 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.342764 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.342857 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.343071 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.343199 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.343378 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.343468 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.343683 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.343781 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.343982 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.344068 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.344301 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.344430 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.344653 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.344740 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.344962 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.345048 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.345323 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.345414 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.345628 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.345713 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.345937 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.346033 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.346917 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.347341 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.347426 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.347506 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.347586 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.347676 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.347759 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.347847 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.348051 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.348140 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.348393 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.348500 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.348712 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.348800 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.349030 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.349116 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.349331 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.349433 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.349636 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.349723 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.349960 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.350046 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.350260 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.350356 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.350563 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.350651 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.350863 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.350950 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.351182 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.351322 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.351484 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.351573 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.351803 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.351891 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.352124 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.352211 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.352464 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.352555 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.352778 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.352866 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.353094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.353224 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.353409 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.353536 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.353727 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.353845 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.354043 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.354164 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.354359 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.354483 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.354675 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.354805 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.354989 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.355107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.355301 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.355416 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.355615 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.355711 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.355929 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.356017 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.356238 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.356347 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.356592 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.356693 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.356907 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.356996 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.357215 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.357304 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.357529 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.357675 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.357837 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.357926 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.358144 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.358230 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.358448 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.358536 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.358857 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.358944 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.359183 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.359291 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.359490 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.359595 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.359797 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.359891 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.360111 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.360199 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.360449 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.360538 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.360756 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.360844 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.361061 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.361160 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.361364 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.361453 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.361665 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.361839 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.362528 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.363072 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.363182 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.363182 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.363342 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.363425 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.363504 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.363723 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.363812 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.364025 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.364126 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.364348 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.364443 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.364669 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.364758 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.364971 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.365061 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.365289 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.365385 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.365599 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.365693 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.365917 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.366011 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.366285 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.366386 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.366524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.366619 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.366845 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.366969 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.367162 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.367289 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.367466 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.367602 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.367770 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.368025 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.368114 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.368372 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.368465 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.368692 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.368790 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.369020 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.369107 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.369349 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.369458 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.369672 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.369767 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.369978 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.370072 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.370294 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.370384 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.370605 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.370694 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.370915 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.371002 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.371227 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.371328 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.371549 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.371637 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.371849 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.371938 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.372150 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.372247 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.372483 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.372574 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.372788 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.372887 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.373094 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.373191 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.373394 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.373491 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.373700 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.373831 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.374000 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.374162 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.374302 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.374476 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.374600 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.374799 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.374920 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.375127 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.375216 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.375435 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.375531 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.375745 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.375842 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.376057 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.376144 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.376390 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.376492 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.376701 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.376804 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.377030 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.377119 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.377331 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.377422 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.378255 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.378417 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.378569 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.378749 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.378890 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.379065 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.379216 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.379451 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.379563 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.379691 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.379836 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.380020 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.380152 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.380357 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.380492 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.380691 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.380807 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.381018 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.381119 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.381347 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.381436 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.381677 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.381764 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.381988 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.382086 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.382301 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.382388 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.382613 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.382700 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.382920 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.383015 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.383229 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.383326 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.383531 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.383745 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.383876 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.384072 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.384186 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.384412 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.384538 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.384727 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.384875 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.385040 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.385211 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.385351 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.385525 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.385665 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.385865 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.385975 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.386198 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.386286 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.386521 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.386671 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.386840 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.386929 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.387172 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.387260 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.387483 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.387585 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.387795 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.387883 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.388109 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.388205 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.388443 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.388534 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.388754 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.388844 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.389062 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.389150 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.389372 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.389460 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.389679 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.389769 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.389985 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.390073 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.390305 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.390402 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.390615 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.390702 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.390929 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.391025 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.391242 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.391338 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.391552 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.391641 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.391861 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.391958 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.392172 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.392258 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.392504 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.392591 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.392814 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.392918 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.393159 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.393379 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.393557 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.393764 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.394019 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.394114 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.394195 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.394409 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.394506 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.394726 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.394825 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.395040 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.395129 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.395350 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.395446 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.395664 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.395764 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.396049 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.396177 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.396403 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.396510 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.396733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.396852 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.397055 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.397152 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.397378 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.397467 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.397700 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.397791 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.398016 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.398104 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.398338 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.398435 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.398659 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.398750 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.398964 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.399059 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.399275 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.399495 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.399592 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.399830 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.399922 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.400151 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.400239 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.400495 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.400596 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.400798 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.400889 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.401113 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.401209 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.401419 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.401522 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.401746 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.401945 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.402064 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.402289 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.402391 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.402603 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.402691 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.402934 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.403024 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.403260 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.403361 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.403574 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.403670 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.403879 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.403970 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.404201 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.404343 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.404532 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.404620 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.404835 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.404937 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.405145 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.405235 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.405453 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.405542 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.405755 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.405842 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.406060 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.406149 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.406368 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.406456 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.406673 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.406827 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.406975 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.407072 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.407283 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.407379 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.407587 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.407688 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.407909 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.408005 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.408211 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.408320 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.408540 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.408641 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.409023 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.409396 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.409396 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.409550 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.409620 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.409700 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.409858 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.409974 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.410160 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.410318 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.410462 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.410644 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.410770 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.410968 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.411066 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.411287 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.411390 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.411608 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.411704 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.411945 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.412134 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.412245 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.412491 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.412592 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.412830 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.412919 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.413163 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.413268 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.413493 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.413582 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.413799 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.413893 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.414113 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.414210 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.414423 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.414513 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.414736 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.414822 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.415043 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.415138 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.415351 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.415441 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.415659 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.415746 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.415967 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.416066 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.416317 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.416535 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.416625 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.416869 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.416974 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.417189 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.417278 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.417517 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.417607 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.417844 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.418064 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.418173 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.418417 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.418506 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.418728 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.418814 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.419050 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.419140 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.419360 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.419448 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.419666 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.419816 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.419997 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.420097 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.420293 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.420385 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.420605 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.420706 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.420913 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.421003 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.421220 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.421571 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.421791 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.421889 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.422097 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.422184 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.422400 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.422487 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.422705 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.422802 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.423014 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.423103 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.423320 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.423407 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.423635 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.423725 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.423945 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.424033 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.424257 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.425138 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.425244 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.425328 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.425409 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.425706 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.425807 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.426012 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.426118 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.426321 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.426410 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.426625 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.426713 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.426938 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.427036 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.427250 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.427337 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.427564 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.427660 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.427866 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.427954 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.428183 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.428332 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.428525 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.428614 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.428837 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.428964 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.429155 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.429244 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.429464 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.429552 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.429777 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.429867 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.430114 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.430208 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.430425 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.430522 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.430740 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.430828 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.431046 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.431132 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.431373 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.431536 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.431688 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.431776 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.432018 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.432114 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.432359 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.432469 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.432665 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.432753 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.432975 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.433065 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.433277 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.433379 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.433583 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.433848 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.433937 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.434189 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.434286 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.434489 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.434577 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.434793 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.434884 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.435100 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.435197 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.435401 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.435490 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.435707 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.435805 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.436009 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.436108 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.436329 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.436421 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.436638 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.436728 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.436939 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.437083 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.437241 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.437331 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.437543 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.437632 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.437844 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.437935 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.438145 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.438233 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.438445 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.438534 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.438751 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.438848 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.439051 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.439147 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.439353 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.439442 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.439655 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.439746 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.440019 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.440621 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.440729 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.440828 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.440914 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.440996 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.441076 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.441157 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.441292 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.441431 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.441612 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.441754 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.441968 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.442065 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.442242 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.442379 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.442549 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.442693 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.442874 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.443009 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.443210 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.443310 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.443504 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.443629 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.443810 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.443964 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.444137 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.444303 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.444475 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.444615 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.444796 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.445043 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.445143 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.445365 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.445455 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.445690 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.445779 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.445994 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.446094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.446315 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.446404 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.446640 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.446734 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.446944 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.447032 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.447268 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.447372 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.447581 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.447670 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.447894 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.447983 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.448204 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.448316 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.448538 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.448639 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.448868 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.448958 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.449181 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.449269 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.449490 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.449587 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.449805 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.449893 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.450117 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.450206 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.450429 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.450532 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.450742 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.450830 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.451052 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.451139 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.451366 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.451463 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.451678 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.451766 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.451991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.452079 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.452322 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.452428 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.452635 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.452723 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.452943 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.453032 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.453253 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.453343 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.453564 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.453659 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.453872 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.453968 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.454181 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.454277 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.454487 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.454584 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.454733 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:38:59.454821 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.455100 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.455409 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.456552 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.456661 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.456926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.457236 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.457546 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.457856 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.458194 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.458536 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.458859 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.459189 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.459507 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.459836 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.460152 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.460502 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.460832 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.461154 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.461470 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.461812 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.462128 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.462444 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.462759 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.463078 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.463388 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.463701 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.464032 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.464389 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.464704 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.465033 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.465357 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.465682 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.466001 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.466318 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.466653 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.467014 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.467331 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.467654 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.467972 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.468317 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.468633 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.468956 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.469290 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.469622 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.469956 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.470289 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.470643 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.470971 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.471954 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.472418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.472606 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.472926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.473246 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:38:59.473495 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:38:59.478880 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG oslo_db.sqlalchemy.engines [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:38:59.496116 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_db.sqlalchemy.engines [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:38:59.541829 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.context [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4e87edd6-9f68-4d34-8025-7f45c9cb24ad(cell1) {{(pid=119843) load_cells /opt/stack/nova/nova/context.py:464}} May 10 16:38:59.546125 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG oslo_concurrency.lockutils [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:38:59.547944 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG oslo_concurrency.lockutils [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:38:59.548749 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG oslo_concurrency.lockutils [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:38:59.550806 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG oslo_concurrency.lockutils [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:38:59.560572 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.context [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4e87edd6-9f68-4d34-8025-7f45c9cb24ad(cell1) {{(pid=119844) load_cells /opt/stack/nova/nova/context.py:464}} May 10 16:38:59.561763 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG oslo_db.sqlalchemy.engines [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:38:59.565759 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:38:59.566108 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG oslo_db.sqlalchemy.engines [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:38:59.567353 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:38:59.568149 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:38:59.570115 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:38:59.584558 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_db.sqlalchemy.engines [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:38:59.587773 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_db.sqlalchemy.engines [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:38:59.726353 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG oslo_db.sqlalchemy.engines [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:38:59.747996 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_db.sqlalchemy.engines [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:39:00.072406 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: WARNING keystonemiddleware.auth_token [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:39:00.079135 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: WARNING keystonemiddleware.auth_token [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:39:00.079832 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: WARNING keystonemiddleware.auth_token [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:39:00.087041 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: WARNING keystonemiddleware.auth_token [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:39:00.424109 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: WARNING keystonemiddleware.auth_token [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:39:00.431042 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: WARNING keystonemiddleware.auth_token [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:39:00.436114 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ff6b1f9c0 pid: 119844 (default app) May 10 16:39:00.438280 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:39:00.439480 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001778 May 10 16:39:00.439930 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Tue May 10 16:39:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:39:00.442925 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: WARNING keystonemiddleware.auth_token [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:39:00.449129 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: WARNING keystonemiddleware.auth_token [None req-429be47b-ec06-4452-ab8a-c612d7062e75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:39:00.455344 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ff6b1f9c0 pid: 119843 (default app) May 10 16:40:20.365064 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:20.366058 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 10 16:40:20.366695 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:20.807073 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-3d6e3c2a-1c9c-4272-8d67-5ffa0ca52c6a admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:20.836872 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-3d6e3c2a-1c9c-4272-8d67-5ffa0ca52c6a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.463408 May 10 16:40:20.837634 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Tue May 10 16:40:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:40:23.158550 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:23.159554 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-a330f0a4-d430-4bb8-81fb-79d5c36a20b8 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 May 10 16:40:23.159946 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:23.233644 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-fa1e86ce-6d9f-40fe-aef0-805bd035d327 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1}} {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:23.253189 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:40:23.253189 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: warnings.warn(msg) May 10 16:40:23.283824 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-fa1e86ce-6d9f-40fe-aef0-805bd035d327 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116810 May 10 16:40:23.284426 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 10 16:40:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:40:23.510432 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-7e3f3d70-9d80-4bf0-aea8-3558db354baa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:23.512842 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:40:23.512842 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: warnings.warn(msg) May 10 16:40:23.564504 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-7e3f3d70-9d80-4bf0-aea8-3558db354baa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.271664 May 10 16:40:23.579959 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Tue May 10 16:40:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:40:25.864643 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-fa1e86ce-6d9f-40fe-aef0-805bd035d327 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:25.865990 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-fa1e86ce-6d9f-40fe-aef0-805bd035d327 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 May 10 16:40:25.866915 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:25.987377 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-56566fb2-94d1-4835-83bb-8657ac81e5d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "id": "d1"}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:26.018714 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:40:26.018714 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: warnings.warn(msg) May 10 16:40:26.038785 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-56566fb2-94d1-4835-83bb-8657ac81e5d8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.162910 May 10 16:40:26.039363 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 10 16:40:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:40:26.051407 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-bc19221b-a84f-454d-a64f-59f549320d3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:26.052926 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:40:26.052926 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: warnings.warn(msg) May 10 16:40:26.085014 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-bc19221b-a84f-454d-a64f-59f549320d3f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037594 May 10 16:40:26.085525 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Tue May 10 16:40:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:40:28.835061 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-56566fb2-94d1-4835-83bb-8657ac81e5d8 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:28.836002 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-56566fb2-94d1-4835-83bb-8657ac81e5d8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 10 16:40:28.836481 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:28.923782 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-fce5d00b-d415-4b7e-bc3d-1737459c766f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "id": "d2", "swap": 0, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:28.947476 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-fce5d00b-d415-4b7e-bc3d-1737459c766f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.104693 May 10 16:40:28.948215 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 10 16:40:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:40:28.961156 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-94f77e31-a7ba-45a5-bde1-5c30251bf912 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:28.987819 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-94f77e31-a7ba-45a5-bde1-5c30251bf912 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030308 May 10 16:40:28.988491 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Tue May 10 16:40:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:40:31.491773 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-fce5d00b-d415-4b7e-bc3d-1737459c766f admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:31.493278 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-fce5d00b-d415-4b7e-bc3d-1737459c766f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 May 10 16:40:31.493863 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:31.557780 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-a5bacd4c-9ab6-4b6e-befa-bed6054b2bb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "id": "d3"}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:31.577565 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-a5bacd4c-9ab6-4b6e-befa-bed6054b2bb5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077294 May 10 16:40:31.578215 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 10 16:40:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:40:31.590165 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-7adb49a7-fd6a-4134-ae57-4e07778d45ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:31.614399 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-7adb49a7-fd6a-4134-ae57-4e07778d45ee admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028090 May 10 16:40:31.615789 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Tue May 10 16:40:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:40:34.014347 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-a5bacd4c-9ab6-4b6e-befa-bed6054b2bb5 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:34.015576 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-a5bacd4c-9ab6-4b6e-befa-bed6054b2bb5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 May 10 16:40:34.016177 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:34.076789 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-410da5fc-62b7-48e3-b8ab-5ac82997d7f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "swap": 0, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:34.097402 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-410da5fc-62b7-48e3-b8ab-5ac82997d7f3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074618 May 10 16:40:34.098196 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 10 16:40:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:40:34.110145 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-45c327d7-006b-4791-ad01-12a608888af8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:34.137844 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-45c327d7-006b-4791-ad01-12a608888af8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031671 May 10 16:40:34.138859 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Tue May 10 16:40:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:40:36.461241 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-410da5fc-62b7-48e3-b8ab-5ac82997d7f3 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:36.462307 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-410da5fc-62b7-48e3-b8ab-5ac82997d7f3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 10 16:40:36.463018 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:36.542832 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-d6255ef4-5dd5-41c3-9171-52ad30d3f358 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:36.571118 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-d6255ef4-5dd5-41c3-9171-52ad30d3f358 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.101618 May 10 16:40:36.571687 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Tue May 10 16:40:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:40:39.179726 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-410da5fc-62b7-48e3-b8ab-5ac82997d7f3 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:39.181084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-410da5fc-62b7-48e3-b8ab-5ac82997d7f3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001861 May 10 16:40:39.181564 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:39.244519 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-00b768e0-2ce5-4cb0-975f-98d88e4de0d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:39.264313 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-00b768e0-2ce5-4cb0-975f-98d88e4de0d2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075293 May 10 16:40:39.265026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 10 16:40:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:40:39.279046 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-727f5bf6-f988-4edf-bda3-675d103cf96c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:39.304072 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-727f5bf6-f988-4edf-bda3-675d103cf96c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028869 May 10 16:40:39.304714 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Tue May 10 16:40:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:40:42.256195 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-00b768e0-2ce5-4cb0-975f-98d88e4de0d2 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:42.257281 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-00b768e0-2ce5-4cb0-975f-98d88e4de0d2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 May 10 16:40:42.257683 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:42.321764 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-1d375e26-7c00-4c95-8709-110c9232ca34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 2048, "disk": 20}} {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:42.342764 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-1d375e26-7c00-4c95-8709-110c9232ca34 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077329 May 10 16:40:42.350786 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 10 16:40:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:40:42.357143 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-c144874f-1878-49dd-a210-64c28ea07ed1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:42.382876 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-c144874f-1878-49dd-a210-64c28ea07ed1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030648 May 10 16:40:42.383453 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Tue May 10 16:40:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:40:44.793726 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-1d375e26-7c00-4c95-8709-110c9232ca34 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:44.794746 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-1d375e26-7c00-4c95-8709-110c9232ca34 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 10 16:40:44.795421 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:44.870095 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-d6c9d6fa-ea93-4776-ab77-b54892aa8d4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "id": "3"}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:44.894671 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-d6c9d6fa-ea93-4776-ab77-b54892aa8d4e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.088329 May 10 16:40:44.895215 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 10 16:40:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:40:44.906847 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-12ed5588-6f24-4c5c-a7c4-2fad92d9269a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:44.943832 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-12ed5588-6f24-4c5c-a7c4-2fad92d9269a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040317 May 10 16:40:44.945802 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Tue May 10 16:40:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:40:47.330270 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-d6c9d6fa-ea93-4776-ab77-b54892aa8d4e admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:47.332218 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-d6c9d6fa-ea93-4776-ab77-b54892aa8d4e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003119 May 10 16:40:47.332957 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:47.415648 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-6c054430-4a19-42c8-ba2e-932ececa468c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "id": "4"}} {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:47.446326 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-6c054430-4a19-42c8-ba2e-932ececa468c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.105594 May 10 16:40:47.447666 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 10 16:40:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:40:47.465569 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-876bbd26-4755-49e4-a2b4-d00c01fa6813 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:47.504826 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-876bbd26-4755-49e4-a2b4-d00c01fa6813 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045660 May 10 16:40:47.505706 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Tue May 10 16:40:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:40:50.039630 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-6c054430-4a19-42c8-ba2e-932ececa468c admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:40:50.041377 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-6c054430-4a19-42c8-ba2e-932ececa468c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002438 May 10 16:40:50.042150 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:40:50.105871 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-8c6217c1-f55c-494b-b806-0093691725c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:50.125372 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-8c6217c1-f55c-494b-b806-0093691725c4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076836 May 10 16:40:50.126274 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Tue May 10 16:40:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:40:50.138194 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-2450a66c-5508-4647-bceb-fb5d3755034e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:40:50.164055 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-2450a66c-5508-4647-bceb-fb5d3755034e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029484 May 10 16:40:50.165113 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Tue May 10 16:40:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:41:14.496152 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-8c6217c1-f55c-494b-b806-0093691725c4 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:14.497224 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-8c6217c1-f55c-494b-b806-0093691725c4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 10 16:41:14.497611 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:41:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:41:14.558060 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-0935665f-74c5-4ff8-a363-e90ac30c72b1 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:14.577381 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-0935665f-74c5-4ff8-a363-e90ac30c72b1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073542 May 10 16:41:14.577949 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Tue May 10 16:41:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:41:15.624782 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-8c6217c1-f55c-494b-b806-0093691725c4 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:15.625789 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-8c6217c1-f55c-494b-b806-0093691725c4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 10 16:41:15.626737 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:41:15.866234 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-4abfa903-3c6f-43a9-9238-509d3e4dda9d admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:15.871858 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.wsgi [None req-4abfa903-3c6f-43a9-9238-509d3e4dda9d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-4abfa903-3c6f-43a9-9238-509d3e4dda9d admin admin] Request method failure captured: May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Accept: application/json May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Accept-Encoding: gzip, deflate May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Connection: keep-alive May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Content-Length: 0 May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Host: 10.222.0.48 May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Openstack-Api-Version: compute 2.90 May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Openstack-System-Scope: None May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: User-Agent: python-novaclient May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Auth-Token: gAAAAABiepWrJnYCv_jaXICEP7amr6F-VzXtcsDLEBykvRr7DMqfg43VZuv6jg2ArmmPZGCCpTxDuFJCrvCJXk7Nd2KddB0jGRfeg6uS2sGyS7PYT78f1qkAMh6HTalgB2jORgZrgaL5ayPaa2VNooZrUjkl4-sCfqd3s0FuszrCVye7w2ZLUdw May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Domain-Id: None May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Domain-Name: None May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Identity-Status: Confirmed May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Is-Admin-Project: True May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Domain-Id: default May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Domain-Name: Default May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Name: admin May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Role: reader,admin,member May 10 16:41:15.875107 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Roles: reader,admin,member May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Tenant: admin May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Tenant-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Tenant-Name: admin May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User: admin May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Domain-Id: default May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Domain-Name: Default May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Id: 2e2d8842c7d74786b278cdcd7a3dd77d May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Name: admin May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: method: > May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: exception: Flavor 42 could not be found. May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: action_args: {'id': '42'} May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:41:15.876976 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:15.878084 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:15.879481 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-4abfa903-3c6f-43a9-9238-509d3e4dda9d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=119843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:41:15.880925 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-4abfa903-3c6f-43a9-9238-509d3e4dda9d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.067541 May 10 16:41:15.880925 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 10 16:41:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 16:41:15.887153 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-0721f41f-41c0-4054-94f1-ec54b33fc315 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:15.909254 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-0721f41f-41c0-4054-94f1-ec54b33fc315 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025567 May 10 16:41:15.909830 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 10 16:41:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:41:15.919773 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-2326887d-2c62-45cc-a50a-e1bd21d6613a admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:15.941534 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-2326887d-2c62-45cc-a50a-e1bd21d6613a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025417 May 10 16:41:15.942108 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 10 16:41:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:41:15.951574 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-bfa22654-a520-4ac1-b252-bb97f71ffe76 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:15.957863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.wsgi [None req-bfa22654-a520-4ac1-b252-bb97f71ffe76 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-bfa22654-a520-4ac1-b252-bb97f71ffe76 admin admin] Request method failure captured: May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Accept: application/json May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Accept-Encoding: gzip, deflate May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Connection: keep-alive May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Content-Length: 0 May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Host: 10.222.0.48 May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Openstack-Api-Version: compute 2.90 May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Openstack-System-Scope: None May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: User-Agent: python-novaclient May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Auth-Token: gAAAAABiepWrJnYCv_jaXICEP7amr6F-VzXtcsDLEBykvRr7DMqfg43VZuv6jg2ArmmPZGCCpTxDuFJCrvCJXk7Nd2KddB0jGRfeg6uS2sGyS7PYT78f1qkAMh6HTalgB2jORgZrgaL5ayPaa2VNooZrUjkl4-sCfqd3s0FuszrCVye7w2ZLUdw May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Domain-Id: None May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Domain-Name: None May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Identity-Status: Confirmed May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Is-Admin-Project: True May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Domain-Id: default May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Domain-Name: Default May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Name: admin May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Role: reader,admin,member May 10 16:41:15.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Roles: reader,admin,member May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Tenant: admin May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Tenant-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Tenant-Name: admin May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User: admin May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Domain-Id: default May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Domain-Name: Default May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Id: 2e2d8842c7d74786b278cdcd7a3dd77d May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Name: admin May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: method: > May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: exception: Flavor 42 could not be found. May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: action_args: {'id': '42'} May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:41:15.962638 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:15.963603 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:15.964991 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-bfa22654-a520-4ac1-b252-bb97f71ffe76 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=119844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:41:15.966219 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-bfa22654-a520-4ac1-b252-bb97f71ffe76 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014608 May 10 16:41:15.966219 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 10 16:41:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 16:41:16.909325 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-2326887d-2c62-45cc-a50a-e1bd21d6613a admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:16.910348 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-2326887d-2c62-45cc-a50a-e1bd21d6613a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 10 16:41:16.910788 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:41:17.108972 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-38fabe6c-5e4c-4399-b875-8b55f05624ab admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:17.114906 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.wsgi [None req-38fabe6c-5e4c-4399-b875-8b55f05624ab admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-38fabe6c-5e4c-4399-b875-8b55f05624ab admin admin] Request method failure captured: May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Accept: application/json May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Accept-Encoding: gzip, deflate May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Connection: keep-alive May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Content-Length: 0 May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Host: 10.222.0.48 May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Openstack-Api-Version: compute 2.90 May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Openstack-System-Scope: None May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: User-Agent: python-novaclient May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Auth-Token: gAAAAABiepWsAB0JsvGt2V5r5oCBX1KEnO29WLLwfbT-aLb51tVwBeMbH3lJgybJfrGGlSMsxGIAj2-sFhjpsEW2F9Gn_zC026U-It84yLCrL9KMN5sqn3zVWyDDZ8z8TJ68q4L53N2QYSi0XbPugdS2SflOl2kR_JMEgUzZ7KQq_0PhHbtfl6c May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Domain-Id: None May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Domain-Name: None May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Identity-Status: Confirmed May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Is-Admin-Project: True May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Domain-Id: default May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Domain-Name: Default May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Name: admin May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Role: reader,admin,member May 10 16:41:17.116510 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Roles: reader,admin,member May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Tenant: admin May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Tenant-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Tenant-Name: admin May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User: admin May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Domain-Id: default May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Domain-Name: Default May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Id: 2e2d8842c7d74786b278cdcd7a3dd77d May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Name: admin May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: method: > May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: exception: Flavor 84 could not be found. May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: action_args: {'id': '84'} May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:41:17.118094 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:17.118904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:17.120026 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-38fabe6c-5e4c-4399-b875-8b55f05624ab admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=119844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:41:17.121187 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-38fabe6c-5e4c-4399-b875-8b55f05624ab admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065158 May 10 16:41:17.121187 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 10 16:41:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 16:41:17.127880 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-02030c33-abb0-4fe8-bf1e-bd402bb94efd admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:17.141725 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-02030c33-abb0-4fe8-bf1e-bd402bb94efd admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017499 May 10 16:41:17.142287 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 10 16:41:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:41:17.152128 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-2dd2c868-83ec-466f-8d13-8e6df631c3bc admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:17.166349 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-2dd2c868-83ec-466f-8d13-8e6df631c3bc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017826 May 10 16:41:17.166904 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 10 16:41:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:41:17.178054 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-3f318e46-35e1-47ce-8882-b6663fe54f5c admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:17.183573 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.wsgi [None req-3f318e46-35e1-47ce-8882-b6663fe54f5c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-3f318e46-35e1-47ce-8882-b6663fe54f5c admin admin] Request method failure captured: May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Accept: application/json May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Accept-Encoding: gzip, deflate May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Connection: keep-alive May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Content-Length: 0 May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Host: 10.222.0.48 May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Openstack-Api-Version: compute 2.90 May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Openstack-System-Scope: None May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: User-Agent: python-novaclient May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Auth-Token: gAAAAABiepWsAB0JsvGt2V5r5oCBX1KEnO29WLLwfbT-aLb51tVwBeMbH3lJgybJfrGGlSMsxGIAj2-sFhjpsEW2F9Gn_zC026U-It84yLCrL9KMN5sqn3zVWyDDZ8z8TJ68q4L53N2QYSi0XbPugdS2SflOl2kR_JMEgUzZ7KQq_0PhHbtfl6c May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Domain-Id: None May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Domain-Name: None May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Identity-Status: Confirmed May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Is-Admin-Project: True May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Domain-Id: default May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Domain-Name: Default May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Name: admin May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Role: reader,admin,member May 10 16:41:17.185099 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Roles: reader,admin,member May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Tenant: admin May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Tenant-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Tenant-Name: admin May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User: admin May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Domain-Id: default May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Domain-Name: Default May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Id: 2e2d8842c7d74786b278cdcd7a3dd77d May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Name: admin May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: method: > May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: exception: Flavor 84 could not be found. May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: action_args: {'id': '84'} May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:41:17.186661 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:17.187524 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:17.188732 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-3f318e46-35e1-47ce-8882-b6663fe54f5c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=119843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:41:17.189958 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-3f318e46-35e1-47ce-8882-b6663fe54f5c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013465 May 10 16:41:17.189958 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Tue May 10 16:41:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 16:41:18.142474 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-2dd2c868-83ec-466f-8d13-8e6df631c3bc admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:18.143475 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-2dd2c868-83ec-466f-8d13-8e6df631c3bc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001910 May 10 16:41:18.143864 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:41:18.337176 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-679f85ca-cca4-4bd3-b6ae-e2ea69728f17 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:18.343072 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.wsgi [None req-679f85ca-cca4-4bd3-b6ae-e2ea69728f17 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-679f85ca-cca4-4bd3-b6ae-e2ea69728f17 admin admin] Request method failure captured: May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Accept: application/json May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Accept-Encoding: gzip, deflate May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Connection: keep-alive May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Content-Length: 0 May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Host: 10.222.0.48 May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Openstack-Api-Version: compute 2.90 May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Openstack-System-Scope: None May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: User-Agent: python-novaclient May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Auth-Token: gAAAAABiepWuucYVqSMirihCuE0QSXxnxNyT66f2BopVE6mf5VhNy0En5N95bqbIl-GdXrG480NTxvN8qVzF8Hp7K8z329RBUia7t7fjgDgnWEPCNxubX9l-FzNBs0KymG4A2wTm0NDnKl677VQ84HnHSiIDxZ-KqrUJosHwR2jmP30mdN-9NmE May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Domain-Id: None May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Domain-Name: None May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Identity-Status: Confirmed May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Is-Admin-Project: True May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Domain-Id: default May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Domain-Name: Default May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Project-Name: admin May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Role: reader,admin,member May 10 16:41:18.344735 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Roles: reader,admin,member May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Tenant: admin May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Tenant-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-Tenant-Name: admin May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User: admin May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Domain-Id: default May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Domain-Name: Default May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Id: 2e2d8842c7d74786b278cdcd7a3dd77d May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: X-User-Name: admin May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: method: > May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: exception: Flavor 451 could not be found. May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: action_args: {'id': '451'} May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:41:18.346825 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:18.347885 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: ERROR nova.api.openstack.wsgi May 10 16:41:18.349415 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-679f85ca-cca4-4bd3-b6ae-e2ea69728f17 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=119843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:41:18.350658 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-679f85ca-cca4-4bd3-b6ae-e2ea69728f17 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066756 May 10 16:41:18.350658 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 10 16:41:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 16:41:18.356697 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-ccb2546b-dd75-41ce-ba2d-4a1aca02694f admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:18.371100 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-ccb2546b-dd75-41ce-ba2d-4a1aca02694f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017897 May 10 16:41:18.371646 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 10 16:41:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:41:18.381897 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:18.397128 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018709 May 10 16:41:18.397701 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Tue May 10 16:41:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:41:18.408151 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-da0ea3c9-6deb-407d-b00d-276b961d01f7 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:18.413914 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.wsgi [None req-da0ea3c9-6deb-407d-b00d-276b961d01f7 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-da0ea3c9-6deb-407d-b00d-276b961d01f7 admin admin] Request method failure captured: May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Accept: application/json May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Accept-Encoding: gzip, deflate May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Connection: keep-alive May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Content-Length: 0 May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Host: 10.222.0.48 May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Openstack-Api-Version: compute 2.90 May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Openstack-System-Scope: None May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: User-Agent: python-novaclient May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Auth-Token: gAAAAABiepWuucYVqSMirihCuE0QSXxnxNyT66f2BopVE6mf5VhNy0En5N95bqbIl-GdXrG480NTxvN8qVzF8Hp7K8z329RBUia7t7fjgDgnWEPCNxubX9l-FzNBs0KymG4A2wTm0NDnKl677VQ84HnHSiIDxZ-KqrUJosHwR2jmP30mdN-9NmE May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Domain-Id: None May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Domain-Name: None May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Identity-Status: Confirmed May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Is-Admin-Project: True May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Domain-Id: default May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Domain-Name: Default May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Project-Name: admin May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Role: reader,admin,member May 10 16:41:18.415418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Roles: reader,admin,member May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_18061f9244ab48daafb61d27ac0a0610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Tenant: admin May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Tenant-Id: 18061f9244ab48daafb61d27ac0a0610 May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-Tenant-Name: admin May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User: admin May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Domain-Id: default May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Domain-Name: Default May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Id: 2e2d8842c7d74786b278cdcd7a3dd77d May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: X-User-Name: admin May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: method: > May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: exception: Flavor 451 could not be found. May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: action_args: {'id': '451'} May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:41:18.416926 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:18.417733 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: ERROR nova.api.openstack.wsgi May 10 16:41:18.418863 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-da0ea3c9-6deb-407d-b00d-276b961d01f7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=119844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:41:18.420102 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-da0ea3c9-6deb-407d-b00d-276b961d01f7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013043 May 10 16:41:18.420102 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 10 16:41:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 16:41:19.354030 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:19.355037 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 10 16:41:19.355463 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:41:19.548147 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-1a283619-cb60-46ce-9c46-5fa07414d5db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:41:19.566789 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-1a283619-cb60-46ce-9c46-5fa07414d5db admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074692 May 10 16:41:19.567318 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 10 16:41:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:41:20.471507 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:20.472666 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 10 16:41:20.473097 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:41:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:41:20.670063 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-44b878d7-0a37-4d9d-9ad7-c6314e20379b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:41:20.688774 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-44b878d7-0a37-4d9d-9ad7-c6314e20379b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074659 May 10 16:41:20.689336 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 10 16:41:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:41:21.599071 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:21.600091 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 10 16:41:21.600736 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:41:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:41:21.797045 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-11acb28b-01bf-4a25-87f2-90aa88ec555d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:41:21.816211 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-11acb28b-01bf-4a25-87f2-90aa88ec555d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072861 May 10 16:41:21.816794 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 10 16:41:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:41:22.732252 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:22.733292 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 May 10 16:41:22.733703 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:41:22.928008 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-fe54b320-f3e3-4d58-9384-d2e90b57698f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:41:22.946062 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-fe54b320-f3e3-4d58-9384-d2e90b57698f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072642 May 10 16:41:22.946535 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Tue May 10 16:41:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:41:23.854133 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:23.855147 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 10 16:41:23.855554 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:41:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:41:24.051471 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-e16dc1fb-f85b-468d-ac6b-34e080a49735 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:41:24.070982 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-e16dc1fb-f85b-468d-ac6b-34e080a49735 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073753 May 10 16:41:24.071520 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Tue May 10 16:41:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:42:29.945278 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:42:29.946780 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-48d4dc5c-a745-47fb-83d3-559cabae12a2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 May 10 16:42:29.947317 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Tue May 10 16:42:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:42:30.014263 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-33389a83-37ee-4a2a-bb32-e0f431ac105a admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:42:30.036470 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-33389a83-37ee-4a2a-bb32-e0f431ac105a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.082995 May 10 16:42:30.037242 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Tue May 10 16:42:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:42:30.059995 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-1e11a6ca-aa00-40d3-b366-686be582196b admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:42:30.069555 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-1e11a6ca-aa00-40d3-b366-686be582196b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013400 May 10 16:42:30.070604 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Tue May 10 16:42:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:42:30.083383 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-de67f1c0-a274-40d2-a4d4-3c124e313089 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:42:30.091264 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-de67f1c0-a274-40d2-a4d4-3c124e313089 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011856 May 10 16:42:30.091815 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Tue May 10 16:42:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:42:30.105714 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-bba35d6c-95c2-4c22-9a71-03e90dc1a205 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:42:30.113907 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-bba35d6c-95c2-4c22-9a71-03e90dc1a205 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012980 May 10 16:42:30.114469 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Tue May 10 16:42:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:42:30.129242 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-fa5ea7bd-8035-4cb7-aabe-5687e129ece3 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:42:30.137141 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-fa5ea7bd-8035-4cb7-aabe-5687e129ece3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012490 May 10 16:42:30.137696 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Tue May 10 16:42:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:54.533627 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-bba35d6c-95c2-4c22-9a71-03e90dc1a205 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:54.534655 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-bba35d6c-95c2-4c22-9a71-03e90dc1a205 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 10 16:45:54.535382 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:45:54.828221 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-090deafd-9b06-48cd-906c-a5fe6fe0c339 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:54.829424 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:45:54.829424 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: warnings.warn(msg) May 10 16:45:54.830641 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-090deafd-9b06-48cd-906c-a5fe6fe0c339 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:54.831073 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-090deafd-9b06-48cd-906c-a5fe6fe0c339 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:54.831891 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-090deafd-9b06-48cd-906c-a5fe6fe0c339 admin admin] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:54.832335 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-090deafd-9b06-48cd-906c-a5fe6fe0c339 admin admin] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:54.866590 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-090deafd-9b06-48cd-906c-a5fe6fe0c339 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.167901 May 10 16:45:54.867083 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 10 16:45:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:45:55.936921 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-bba35d6c-95c2-4c22-9a71-03e90dc1a205 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:55.937965 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-bba35d6c-95c2-4c22-9a71-03e90dc1a205 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 May 10 16:45:55.938368 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:56.128635 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-61ac2069-0693-452b-9ea9-7b9c831eb4b6 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:56.129813 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:45:56.129813 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: warnings.warn(msg) May 10 16:45:56.131003 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-61ac2069-0693-452b-9ea9-7b9c831eb4b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:56.131445 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-61ac2069-0693-452b-9ea9-7b9c831eb4b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:56.132229 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-61ac2069-0693-452b-9ea9-7b9c831eb4b6 admin admin] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:56.132697 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-61ac2069-0693-452b-9ea9-7b9c831eb4b6 admin admin] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:56.152513 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-61ac2069-0693-452b-9ea9-7b9c831eb4b6 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074449 May 10 16:45:56.153418 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 10 16:45:56 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:46:07.508510 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-bba35d6c-95c2-4c22-9a71-03e90dc1a205 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:07.509527 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-bba35d6c-95c2-4c22-9a71-03e90dc1a205 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 10 16:46:07.509922 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:46:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:46:07.708947 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-70cf92be-6a6b-4556-9eba-4b7eada8c30d admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:07.710145 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:46:07.710145 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: warnings.warn(msg) May 10 16:46:07.711331 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-70cf92be-6a6b-4556-9eba-4b7eada8c30d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:07.711760 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-70cf92be-6a6b-4556-9eba-4b7eada8c30d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:07.712566 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-70cf92be-6a6b-4556-9eba-4b7eada8c30d admin admin] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:07.712986 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-70cf92be-6a6b-4556-9eba-4b7eada8c30d admin admin] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:07.738305 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-70cf92be-6a6b-4556-9eba-4b7eada8c30d admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.087747 May 10 16:46:07.738786 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 10 16:46:07 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:46:08.663006 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: DEBUG nova.api.openstack.wsgi [None req-bba35d6c-95c2-4c22-9a71-03e90dc1a205 admin admin] Calling method '>' {{(pid=119843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:08.664024 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: INFO nova.api.openstack.requestlog [None req-bba35d6c-95c2-4c22-9a71-03e90dc1a205 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 10 16:46:08.664447 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: [pid: 119843|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Tue May 10 16:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:46:08.859237 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG nova.api.openstack.wsgi [None req-674674f3-8b0f-45fd-9066-90629d29eed1 admin admin] Calling method '>' {{(pid=119844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:08.860514 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:46:08.860514 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: warnings.warn(msg) May 10 16:46:08.861774 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-674674f3-8b0f-45fd-9066-90629d29eed1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:08.862206 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-674674f3-8b0f-45fd-9066-90629d29eed1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:08.862976 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-674674f3-8b0f-45fd-9066-90629d29eed1 admin admin] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:08.863393 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: DEBUG oslo_concurrency.lockutils [None req-674674f3-8b0f-45fd-9066-90629d29eed1 admin admin] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:08.885118 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: INFO nova.api.openstack.requestlog [None req-674674f3-8b0f-45fd-9066-90629d29eed1 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079319 May 10 16:46:08.885675 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: [pid: 119844|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Tue May 10 16:46:08 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:08.983651 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: Tue May 10 16:47:08 2022 - graceful shutdown triggered... May 10 16:47:08.984372 dv-cinder-835881-10-iscsi devstack@n-api.service[119843]: Gracefully killing worker 1 (pid: 119843)... May 10 16:47:08.985104 dv-cinder-835881-10-iscsi devstack@n-api.service[119844]: Gracefully killing worker 2 (pid: 119844)... May 10 16:47:08.985647 dv-cinder-835881-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 16:47:09.984592 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: worker 1 buried after 1 seconds May 10 16:47:09.984592 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: worker 2 buried after 1 seconds May 10 16:47:09.984592 dv-cinder-835881-10-iscsi devstack@n-api.service[119842]: goodbye to uWSGI. May 10 16:47:09.986197 dv-cinder-835881-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 16:47:09.986771 dv-cinder-835881-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 16:47:09.989512 dv-cinder-835881-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 16:47:10.012496 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 16:47:10.049288 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 16:47:10 2022] *** May 10 16:47:10.049288 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 16:47:10.049288 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 16:47:10.049288 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: nodename: dv-cinder-835881-10-iscsi May 10 16:47:10.049288 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: machine: x86_64 May 10 16:47:10.049288 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: clock source: unix May 10 16:47:10.049288 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: pcre jit disabled May 10 16:47:10.049288 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: detected number of CPU cores: 4 May 10 16:47:10.049288 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: current working directory: / May 10 16:47:10.049288 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: detected binary path: /usr/bin/uwsgi-core May 10 16:47:10.050076 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: your processes number limit is 47680 May 10 16:47:10.050076 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: your memory page size is 4096 bytes May 10 16:47:10.050076 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: detected max file descriptor number: 2048 May 10 16:47:10.050076 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: lock engine: pthread robust mutexes May 10 16:47:10.050076 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: thunder lock: enabled May 10 16:47:10.050076 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 16:47:10.050076 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 16:47:10.095800 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: Python main interpreter initialized at 0x56403217f9c0 May 10 16:47:10.095800 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: python threads support enabled May 10 16:47:10.095800 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: your server socket listen backlog is limited to 100 connections May 10 16:47:10.095800 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: your mercy for graceful operations on workers is 90 seconds May 10 16:47:10.096546 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: mapped 403077 bytes (393 KB) for 2 cores May 10 16:47:10.096546 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: *** Operational MODE: preforking *** May 10 16:47:10.096546 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: *** uWSGI is running in multiple interpreter mode *** May 10 16:47:10.096546 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: spawned uWSGI master process (pid: 134176) May 10 16:47:10.097391 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: spawned uWSGI worker 1 (pid: 134194, cores: 1) May 10 16:47:10.096725 dv-cinder-835881-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 16:47:10.098221 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: spawned uWSGI worker 2 (pid: 134195, cores: 1) May 10 16:47:10.098221 dv-cinder-835881-10-iscsi devstack@n-api.service[134176]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 16:47:11.385401 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 16:47:11.432026 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 16:47:12.256374 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:47:12.256374 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: from cryptography.utils import int_from_bytes May 10 16:47:12.256905 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:47:12.256905 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: from cryptography.utils import int_from_bytes May 10 16:47:12.258194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:47:12.258194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: from cryptography.utils import int_from_bytes May 10 16:47:12.258520 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:47:12.258520 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: from cryptography.utils import int_from_bytes May 10 16:47:14.791685 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:47:14.792335 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:47:14.792422 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:47:14.792790 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:47:14.793041 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:47:14.793441 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.793774 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.794098 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.794421 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.794756 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.795115 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.795434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.795758 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.796136 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.796438 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.796762 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.797140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-10-iscsi {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.797470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.797785 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.798099 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.798427 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.798738 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.799069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.799369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-10-iscsi {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.804584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.805111 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.805111 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.805525 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.805746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.806061 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.806365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.806910 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.807252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.807667 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.808010 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.808346 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.808647 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.808958 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.809274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.809584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.809898 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.810202 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.810452 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.810781 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.811114 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.811581 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.811901 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.812161 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.812439 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.812762 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.813085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.813396 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.813707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.814017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.814325 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.814634 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.814941 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.815253 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.815565 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.815881 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.816199 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.816548 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.816859 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.817179 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.817586 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.817841 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.818149 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.818493 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.818822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.819130 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.819449 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.819615 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:47:14.820108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:47:14.820327 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.820327 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.820679 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:47:14.820855 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.821004 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:47:14.821147 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.821302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:47:14.821465 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.821639 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.821791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.821791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.822603 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.822811 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.822974 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.823126 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.823291 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.823443 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.823443 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.823726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.823889 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.823889 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.824180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.824439 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.824600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.824793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.824953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.825109 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.825259 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.825403 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.825552 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.825710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.825854 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.826007 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.826150 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-10-iscsi {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.826301 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.826453 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.826613 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.826881 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.828609 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.828771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.828953 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.829119 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.829287 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.829442 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.829593 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.829748 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.829899 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.830057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.830201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.830201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.830471 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.830633 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.830786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.830937 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.831089 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.831245 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.831399 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.831550 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.831700 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.831851 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.832001 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.832159 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.832349 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.832510 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.832874 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.833034 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.833197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.833501 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.833673 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.833831 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.833975 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.834130 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.834130 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.834411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-10-iscsi {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.834565 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.834715 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.834931 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.835094 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.835247 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.835395 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.835538 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.835538 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.835828 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.835981 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.836124 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.836266 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.836507 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.836649 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.836980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.837141 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.837368 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.837984 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.838252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.838404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.838611 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.839400 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.839562 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.839714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.839857 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.840010 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.840175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.840347 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.840508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.840652 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.841010 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.841181 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.841348 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.841495 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.841495 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.841774 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.841926 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.842216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.842379 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.842532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.842676 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.842982 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.843149 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.843304 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.843579 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.843749 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.843901 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.844044 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.844195 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.844393 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.844547 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.844705 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.844705 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.844990 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.845132 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.845289 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.845451 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.845603 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.845747 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.845889 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.846045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.846188 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.846337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.846494 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.846638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.846781 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.846951 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.847200 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.847347 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.847499 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.847499 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.848428 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.848601 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.848755 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.848948 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.849109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.849253 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.849420 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.849707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.849864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.850015 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.850170 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.850333 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.850486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.850639 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.850789 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.850941 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.851145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.851298 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.851451 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.851594 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.851737 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.851890 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.852041 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.852221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.852221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.852691 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.852836 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.853102 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.853258 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.853463 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.853746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.853904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.854058 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.854201 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.854353 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.854511 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.854675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.854818 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.854962 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.855117 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.855262 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.855420 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.855572 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.855730 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.855730 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.856019 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.856164 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.856341 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.856517 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.856696 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.856859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.857100 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.857455 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.857619 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.857619 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.857910 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.858199 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.858729 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.858897 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.859101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.859101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.859383 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.859546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.859709 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.860009 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.860160 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.860403 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.860558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.860708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.860708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.861037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.861037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.861349 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.861503 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.861648 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.861648 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.861953 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.862105 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.862105 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.862392 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.862392 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.862876 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.863070 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.863341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.863500 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.863653 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.863653 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.864160 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.864335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.865495 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.865784 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.865966 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.866190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.866385 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.866542 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.866689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.866840 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.866840 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.867177 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.867325 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.867598 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.867598 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.867896 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.868056 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.868217 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.868614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.869493 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.869655 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.869810 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.869964 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.870251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.870409 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.870562 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.870719 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.870864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.871024 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.871168 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.871312 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.871475 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.871620 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.871770 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.871932 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.872085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.872253 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.873508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.873678 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.873867 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.874140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.874326 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.874490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.874649 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.874811 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.874986 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.875231 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.875390 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.875548 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.875722 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.876007 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.876007 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.876390 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.876539 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.876693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:47:14.876845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.876988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.877146 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.877298 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.877449 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.877609 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.877847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.878030 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.878272 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.878454 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.878812 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.879201 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.879362 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.879525 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.879678 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.879828 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.879972 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.879972 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.880261 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.880556 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.880705 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.880856 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.881009 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.881152 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.881310 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.881462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.881613 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.881764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.881906 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.882056 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.882208 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.882360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.882503 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.882654 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.882806 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.882968 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.883127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.883296 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.883613 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.883765 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.883907 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.884058 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.885616 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.885771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.885923 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.886076 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.886220 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.886383 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.886535 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.886688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.886832 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.886983 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.887127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.887280 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.887424 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.887567 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.887717 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.887878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.888124 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.888347 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.888538 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.889096 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.889469 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.889630 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.889775 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.889928 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.889928 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.890208 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.890352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.890495 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.890637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.890790 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.890934 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.891106 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.891404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.891565 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.891719 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.891874 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.892024 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.892175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.892337 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.892499 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.892658 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.892803 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.893047 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.893192 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.893354 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.893497 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.893497 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.893990 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.894141 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.894402 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.894561 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.894712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.894712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.894712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.894712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.894712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.895408 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.895562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.895713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.895863 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.896007 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.896158 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.896334 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.896496 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.896640 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.896792 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.896935 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.897088 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.897088 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.897383 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.897527 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.897677 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.897828 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.897979 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.898140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.898383 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.898533 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.898682 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.898844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.899166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.899350 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.899709 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.899871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.900022 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.900212 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.900519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.900780 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.900939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.901085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.901230 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.901394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.901676 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.901836 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.901836 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.902119 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.902275 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.902437 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.903179 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.903349 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.903503 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.903646 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.904001 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.904153 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.904343 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.904606 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.904764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.904922 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.905085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.905243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.905449 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.905609 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.905759 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.905915 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.906073 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.906231 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.906390 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.906549 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.906706 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.906864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.907014 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.907191 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.907404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.907567 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.907718 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.907867 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.908025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.908025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.908378 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.908629 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.908785 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.908934 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.909102 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.909460 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.909749 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.910025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.910187 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.910348 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.910505 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.910672 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.910824 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.910974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.911130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.911288 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.911437 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.911608 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.911896 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.912074 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.912226 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.912427 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.912595 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.912754 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.912911 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.913064 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.913224 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.913374 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.913536 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.913687 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.913836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.914187 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.914345 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.914496 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.914767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.914934 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.915093 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.915093 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.915396 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.915546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.915705 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.915705 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.916043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.916193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.916393 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.916559 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.916711 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.916901 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.917117 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.917272 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.917431 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.917596 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.917748 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.917898 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.918050 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.918212 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.918362 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.918578 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.918856 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.919022 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.919174 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.919539 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.919715 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.919963 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.920348 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.920510 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.920680 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.920831 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.920980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.921137 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.921308 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.921509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.921509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.921810 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.922107 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.922265 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.922423 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.922582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.922747 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.922904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.923057 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.923206 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.923365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.923583 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.923754 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.923905 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.924062 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.924433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.924622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.924810 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.925060 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.925214 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.925376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.925534 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.925693 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.925869 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.926028 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.926185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.926586 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.926586 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.926875 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.927039 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.927197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.927347 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.927503 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.927677 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.927870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.928034 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.928034 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.928399 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.928553 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.928703 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.928883 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.929128 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.929290 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.929457 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.929795 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.929974 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.930229 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.930514 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.930671 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.930831 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.931027 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.931259 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.931994 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.932462 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.932677 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.932853 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.933031 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.933208 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.933397 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.933553 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.933721 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.933902 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.934055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.934291 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.934647 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.934839 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.934996 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.935269 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.935461 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.935627 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.935779 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.935937 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.936088 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.936310 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.936524 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.936692 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.936853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.936853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.937140 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.937290 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.937439 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.937633 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.937818 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.937983 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.938135 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.938291 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.938452 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.938639 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.938802 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.938961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.939133 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.939388 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.939569 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.939947 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.939947 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.940409 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.940713 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.941480 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.941659 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.941813 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.941972 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.942125 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.942274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.942608 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.942778 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.942930 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.943096 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.943274 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.943440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.943601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.943759 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.943931 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.944091 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.944245 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.944422 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.944801 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.944973 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.945135 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.945420 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.945587 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.945748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.945908 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.946060 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.946220 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.946389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.946549 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.946707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.946707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.947001 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.947708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.947893 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.948165 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.948385 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.948545 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.948708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.948872 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.948872 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.949178 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.949330 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.949609 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.949779 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.950150 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.950318 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.950603 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.950959 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.951117 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.951278 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.951438 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.951598 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.951768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.951920 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.952077 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.952238 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.952443 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.952631 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.952921 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.952921 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.953226 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.953404 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.953632 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.953787 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.953946 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.954108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.954259 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.954417 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.954576 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.954576 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.955098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.955267 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.955447 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.956011 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.956183 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.956396 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.956556 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.956706 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.956880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.957335 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.957335 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.957649 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.957801 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.957952 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.958131 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.958284 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.958434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.958590 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.958748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.958913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.959065 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.959226 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.959376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.959535 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.959807 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.959964 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.960352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.960525 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.960804 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.960991 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.960991 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.961431 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.961583 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.961750 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.961901 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.962064 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.962216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.962366 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.962515 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.962694 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.963538 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.963735 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.963892 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.964062 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.964241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.964452 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.964629 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.964790 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.964940 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.965251 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.965425 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.965585 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.965745 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.965904 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.966166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.966325 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.966483 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.966635 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.966799 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.966961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.967111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.967269 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.967519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.967691 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.967844 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.968001 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.968152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.968336 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.968502 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.968663 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.968822 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.968991 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.969143 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.969292 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.969442 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.969606 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.969756 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.969940 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.970098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.970276 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.970638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.970824 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.971074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.971230 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.971546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.971705 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.971941 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.972094 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.972253 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.972493 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.972658 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.972810 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.972969 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.973120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.973120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.973426 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.973735 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.973905 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.974072 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.974231 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.974389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.974546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.974705 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.974856 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.975016 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.975179 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.975444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.975602 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.975762 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.975923 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.976085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.976376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.976535 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.976692 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.976851 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.977016 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.977174 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.977334 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.977512 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.977753 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.977917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.978077 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.978267 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.979150 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.979323 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.979497 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.979674 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.979871 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.979992 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.980087 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.980165 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.980260 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.980463 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.980558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.980642 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.980716 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.980788 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.980860 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.980948 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981035 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981109 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981181 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981253 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981325 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981407 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981481 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981554 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981698 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981769 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981851 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.981924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982064 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982143 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982230 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982312 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982386 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982457 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982528 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982608 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982691 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982851 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.982924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983062 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983216 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983297 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983370 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983449 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983616 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983698 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983777 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983850 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.983929 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984010 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984010 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984150 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984229 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984322 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984411 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984495 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984570 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984721 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984794 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984952 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.984952 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.985092 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.985163 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.985163 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.985303 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.985384 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.985457 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.985535 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.985535 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.985682 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.986996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987094 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987181 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987258 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987330 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987402 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987576 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987697 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987873 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.987954 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988131 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988205 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988304 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988394 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988483 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988652 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988725 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988797 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988867 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.988949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989023 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989095 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989338 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989427 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989590 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989663 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989744 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989841 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.989997 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990076 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990157 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990333 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990415 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990636 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990716 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990716 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990849 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990849 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.990977 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991049 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991132 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991213 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991285 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991356 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991428 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991512 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991585 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991657 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991728 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.991950 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992023 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992109 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992262 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992356 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992575 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992575 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992724 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992816 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992889 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.992961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993336 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993418 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993498 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993585 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993667 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993740 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993812 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993884 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.993962 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.994044 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.994125 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.994239 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.994377 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.994526 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.994694 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.994694 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.994694 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.994694 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995058 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995214 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995305 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995387 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995461 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995540 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995691 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995777 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995851 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995851 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.995989 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996070 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996156 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996229 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996414 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996648 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996732 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996814 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996888 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.996961 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997132 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997314 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997409 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997409 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997576 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997664 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997749 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997749 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.997923 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998028 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998195 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998276 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998357 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998432 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998510 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998510 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998653 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998725 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998804 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998877 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.998958 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999038 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999112 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999336 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999436 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999533 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999621 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999713 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999895 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:14.999981 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.000076 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.000169 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.000256 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.000490 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.000590 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.000692 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.000780 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.000865 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.000950 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.001046 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.001142 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.001328 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.001426 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.001651 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.001747 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.001965 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.002068 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.002281 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.002378 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.002602 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.002697 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.002914 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.003084 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.003231 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.003332 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.003558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.003694 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.003872 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.003993 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.004191 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.004454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.004564 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.004770 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.004865 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.005107 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.005246 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.005432 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.005565 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.005757 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.005906 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.006070 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.006167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.006388 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.006484 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.006712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.006820 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.007018 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.007111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.007324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.007471 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.007637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.007774 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.007947 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.008045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.008252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.008419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.008614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.008757 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.008926 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.009031 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.009234 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.009328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.009611 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.009758 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.009937 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.010083 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.010267 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.010607 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.010792 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.010936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.011078 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.011249 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.011337 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.011593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.011693 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.011933 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.012024 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.012260 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.012371 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.012608 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.012707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.013038 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.013135 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.013249 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.013342 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.013558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.013656 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.013874 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.013955 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.014186 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.014288 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.014490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.014584 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.014796 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.014890 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.015107 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.015208 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.015415 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.015518 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.015719 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.015812 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.016027 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.016120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.016355 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.016454 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.016683 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.016789 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.016990 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.017084 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.017295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.017390 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.017600 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.017696 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.017980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.018091 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.018211 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.018314 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.018516 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.018610 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.018820 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.018967 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.019124 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.019222 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.019436 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.019552 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.019749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.019884 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.020049 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.020219 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.020394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.020564 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.020710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.020896 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.021016 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.021224 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.021319 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.021548 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.021677 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.021873 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.022000 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.022197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.022291 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.022519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.022894 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.023009 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.023122 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.023220 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.023315 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.023497 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.023603 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.023776 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.023883 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.024101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.024196 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.024454 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.024570 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.024783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.025037 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.025870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.026065 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.026271 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.026455 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.026590 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.026675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.026899 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.026996 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.027222 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.027318 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.027544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.027647 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.027864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.027966 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.028173 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.028267 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.028514 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.028653 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.028835 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.028976 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.029144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.029274 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.029457 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.029560 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.030080 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.030188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.030279 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.030365 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.030458 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.030545 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.030662 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.030767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.030971 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.031066 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.031280 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.031375 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.031592 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.031699 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.031901 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.032026 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.032211 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.032370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.032555 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.032660 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.032897 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.032991 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.033219 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.033314 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.033630 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.033799 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.033893 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.033979 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.034169 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.034278 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.034479 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.034573 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.034790 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.034893 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.035100 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.035209 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.035410 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.035505 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.035725 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.035819 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.036053 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.036161 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.036391 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.036490 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.036700 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.036794 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.037045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.037147 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.037369 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.037471 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.037695 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.037790 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.038048 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.038248 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.038363 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.038570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.038685 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.038916 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.039060 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.039249 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.039372 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.039582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.039687 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.039908 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.040010 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.040235 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.040367 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.040636 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.040733 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.041613 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.041832 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.042015 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.042171 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.042308 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.042410 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.042540 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.042637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.042854 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.042956 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.043169 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.043262 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.043492 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.043594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.043808 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.043905 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.044117 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.044222 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.044448 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.044543 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.044763 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.045012 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.045108 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.045368 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.045460 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.045675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.045776 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.045981 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.046074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.046293 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.046390 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.046598 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.046693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.046902 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.046997 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.047208 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.047389 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.047513 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.047759 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.047851 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.048113 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.048213 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.048448 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.048556 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.048755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.048849 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.049062 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.049195 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.049366 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.049506 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.049672 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.049779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.049977 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.050182 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.050310 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.050644 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.050739 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.050961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.051095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.051284 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.051696 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.051865 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.052087 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.052195 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.052514 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.052620 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.052837 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.053106 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.053207 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.053432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.053528 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.053760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.053994 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.054092 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.054186 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.054405 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.054508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.054718 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.054944 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.055030 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.055333 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.055424 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.055646 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.055729 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.055957 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.056144 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.056309 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.056623 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.056853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.056995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.057229 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.057430 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.057550 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.057863 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.057959 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.058187 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.058282 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.058509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.058718 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.058823 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.059140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.059233 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.059455 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.059598 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.059768 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.059955 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.060087 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.060425 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.060559 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.060740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.060837 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.061130 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.061234 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.061468 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.061670 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.061800 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.062019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.062123 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.062387 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.062482 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.062753 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.062897 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.063105 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.063425 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.063617 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.063777 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.064080 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.064189 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.064454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.064549 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.064773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.065033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.065148 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.065316 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:47:15.065419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.065916 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.066398 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.066723 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.067218 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.067714 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.068045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.068502 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.068983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.069351 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.069739 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.070236 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.070834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.071026 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.071350 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.071854 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.072302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.072770 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.073187 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.073644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.074001 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.074344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.074911 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.075365 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.075741 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.076065 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.076621 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.077117 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.077488 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.077818 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.078309 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.078994 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.079346 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.079745 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.080481 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.080929 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.081220 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.082742 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.083190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.084309 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.084309 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.084503 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.085039 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.085553 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.085939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.086343 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.086829 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.087272 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.087605 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.088717 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.089302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.089850 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.090347 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.090691 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.091013 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_db.sqlalchemy.engines [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:47:15.091157 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.091565 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.091985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.092330 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.092805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.093269 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.093631 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.093993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.094501 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.095018 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.095344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.095878 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.096584 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.096980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.097405 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.097859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.098203 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.098576 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.098933 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.099277 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.099630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.099974 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.100341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.100690 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.101079 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.101420 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.101757 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.102084 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.102436 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.102762 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.103091 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.104107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.104855 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.104978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.105297 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.105620 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.105962 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.106289 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.106629 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.106962 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.107299 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.107630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.107954 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.108323 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.108652 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.108977 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.109304 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.109626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.109949 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.110276 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.110602 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.110940 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.111277 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.111613 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.112005 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.112403 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.112726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.113085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.113424 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.113749 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.114133 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.114392 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:47:15.114642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:47:15.139244 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_db.sqlalchemy.engines [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134195) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:47:15.160845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.context [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4e87edd6-9f68-4d34-8025-7f45c9cb24ad(cell1) {{(pid=134194) load_cells /opt/stack/nova/nova/context.py:464}} May 10 16:47:15.165289 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.167003 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.168395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.170391 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.182768 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_db.sqlalchemy.engines [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:47:15.184812 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_db.sqlalchemy.engines [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:47:15.209222 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.context [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4e87edd6-9f68-4d34-8025-7f45c9cb24ad(cell1) {{(pid=134195) load_cells /opt/stack/nova/nova/context.py:464}} May 10 16:47:15.214300 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.215904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.216752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.219440 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.232369 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_db.sqlalchemy.engines [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134195) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:47:15.232369 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_db.sqlalchemy.engines [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134195) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:47:15.351293 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_db.sqlalchemy.engines [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:47:15.398017 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_db.sqlalchemy.engines [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134195) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:47:15.686037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: WARNING keystonemiddleware.auth_token [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:47:15.693832 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: WARNING keystonemiddleware.auth_token [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:47:15.729366 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: WARNING keystonemiddleware.auth_token [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:47:15.738172 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: WARNING keystonemiddleware.auth_token [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:47:16.054830 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: WARNING keystonemiddleware.auth_token [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:47:16.062110 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: WARNING keystonemiddleware.auth_token [None req-31c344ea-e45c-4a06-85ea-a8cdda438c5d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:47:16.067743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56403217f9c0 pid: 134194 (default app) May 10 16:47:16.092738 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: WARNING keystonemiddleware.auth_token [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:47:16.098989 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: WARNING keystonemiddleware.auth_token [None req-92a2dabf-0d1e-4419-abae-260c6fa8745e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:47:16.104484 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56403217f9c0 pid: 134195 (default app) May 10 16:48:01.014025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-20a3dad0-be20-4e61-a2aa-7f9692e94a35 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Action: 'create', calling method: .version_select at 0x7f5fbccdd280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1648586337"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:03.472288 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-20a3dad0-be20-4e61-a2aa-7f9692e94a35 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.156889 May 10 16:48:03.473329 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1154 bytes} [Tue May 10 16:47:59 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4159 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 16:48:04.108419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c95adea9-8ebb-4a73-af4c-f2edc9f00dae tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbcd22160>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:05.378698 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c95adea9-8ebb-4a73-af4c-f2edc9f00dae tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb" status: 200 len: 346 microversion: 2.1 time: 1.895823 May 10 16:48:05.380080 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 1/2] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:48:03 2022] GET /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb => generated 346 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:05.398113 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-63b10988-b73b-4c5b-b1bc-9f3ecad258da tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Action: 'create', calling method: .version_select at 0x7f5fbcbe8430>, body: {"snapshot": {"volume_id": "4bd6ecae-cf73-4708-b814-979b5cb5eaeb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-539640470"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:05.607206 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1221999456", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "networks": [{"uuid": "0b17740a-1b3f-415d-9520-631c81c0c86a"}]}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:05.841613 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] validate_networks() for [('0b17740a-1b3f-415d-9520-631c81c0c86a', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:48:06.023158 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-63b10988-b73b-4c5b-b1bc-9f3ecad258da tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.633956 May 10 16:48:06.026862 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1161 bytes} [Tue May 10 16:48:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:48:06.082975 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2480bbbc-5a49-47f9-9412-384f1a05df26 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbcbe84c0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:06.177075 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2480bbbc-5a49-47f9-9412-384f1a05df26 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5" status: 200 len: 286 microversion: 2.1 time: 0.143226 May 10 16:48:06.177798 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 10 16:48:06 2022] GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:48:06.199498 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9d247473-168d-49fa-8ba3-ecba86eb8948 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbcbe83a0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:06.342996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9d247473-168d-49fa-8ba3-ecba86eb8948 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.158777 May 10 16:48:06.344352 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 4/5] 10.222.0.48 () {58 vars in 1139 bytes} [Tue May 10 16:48:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:06.357390 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1623b7f7-45f5-40a5-b846-396c7511b6d2 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbcb308b0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:06.420709 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1623b7f7-45f5-40a5-b846-396c7511b6d2 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5" status: 200 len: 286 microversion: 2.1 time: 0.070672 May 10 16:48:06.421639 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 5/6] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 10 16:48:06 2022] GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:07.433059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f7010513-a975-47e8-8a64-e1b85df91497 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbcbe8ee0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:07.484059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f7010513-a975-47e8-8a64-e1b85df91497 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5" status: 200 len: 286 microversion: 2.1 time: 0.055907 May 10 16:48:07.485806 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 6/7] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 10 16:48:07 2022] GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:48:07.608590 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:48:07.609491 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:48:07.609999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:48:07.610608 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:48:07.611151 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:48:07.639527 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:07.639986 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:07.641167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:07.641752 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:07.688962 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Getting quotas for project 60f85e7bbb38404ba6b68eff605a3306. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:48:07.719798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Getting quotas for user f4fabe073e2f4fa1bfb6c5fbaf859eac and project 60f85e7bbb38404ba6b68eff605a3306. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:48:07.761481 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:48:07.765662 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:48:07.891405 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a94cb6a2-4ba1-46ab-a29a-4c347f5f5189 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.051305 May 10 16:48:07.893014 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 2/8] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:48:07.905548 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e9f923de-0d75-4eed-a6c5-d2e83f389e57 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:07.906361 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e9f923de-0d75-4eed-a6c5-d2e83f389e57 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:08.463293 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e9f923de-0d75-4eed-a6c5-d2e83f389e57 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:08.493448 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e9f923de-0d75-4eed-a6c5-d2e83f389e57 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1215 microversion: 2.1 time: 0.593291 May 10 16:48:08.494247 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 7/9] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:07 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1215 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:08.499568 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d329d2cc-c3f4-4711-805a-e82422ba84a2 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbc2493a0>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:08.552925 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d329d2cc-c3f4-4711-805a-e82422ba84a2 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5" status: 200 len: 286 microversion: 2.1 time: 0.059687 May 10 16:48:08.553745 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 3/10] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 10 16:48:08 2022] GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:48:09.510802 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a11d34c3-d669-48eb-9111-f453964ca367 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:09.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a11d34c3-d669-48eb-9111-f453964ca367 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:09.569921 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-60349bd9-233b-4763-bd84-3f68c4b4e279 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbcb38790>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:09.634668 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-60349bd9-233b-4763-bd84-3f68c4b4e279 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5" status: 200 len: 287 microversion: 2.1 time: 0.067493 May 10 16:48:09.635835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 4/11] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 10 16:48:09 2022] GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:48:09.659047 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-fcb68757-ce0d-4263-8010-ac7ef6e8ae07 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbc249940>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:09.673457 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a11d34c3-d669-48eb-9111-f453964ca367 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:09.682974 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a11d34c3-d669-48eb-9111-f453964ca367 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1215 microversion: 2.1 time: 0.176247 May 10 16:48:09.718304 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 8/12] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:09 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1215 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:09.781502 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-fcb68757-ce0d-4263-8010-ac7ef6e8ae07 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5" status: 202 len: 0 microversion: 2.1 time: 0.138631 May 10 16:48:09.783393 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 5/13] 10.222.0.48 () {58 vars in 1253 bytes} [Tue May 10 16:48:09 2022] DELETE /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:48:09.792015 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2ce939cc-abec-4518-8d39-c2f54f2ae6ad tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbcafc700>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:09.861647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2ce939cc-abec-4518-8d39-c2f54f2ae6ad tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5" status: 200 len: 286 microversion: 2.1 time: 0.073972 May 10 16:48:09.862271 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 9/14] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 10 16:48:09 2022] GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:10.277637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1765159301", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:10.426497 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] validate_networks() for [('5732deb1-fb33-4f08-9ad5-7d92102702ad', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:48:10.703001 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-dc041971-8bd3-4f47-87be-0399ce4507ad tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:10.703597 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-dc041971-8bd3-4f47-87be-0399ce4507ad tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:10.711758 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc041971-8bd3-4f47-87be-0399ce4507ad tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:10.716393 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc041971-8bd3-4f47-87be-0399ce4507ad tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:10.717406 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc041971-8bd3-4f47-87be-0399ce4507ad tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:10.720424 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc041971-8bd3-4f47-87be-0399ce4507ad tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:11.158231 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-dc041971-8bd3-4f47-87be-0399ce4507ad tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:11.181647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-dc041971-8bd3-4f47-87be-0399ce4507ad tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1219 microversion: 2.1 time: 0.482285 May 10 16:48:11.193072 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 10/15] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:10 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1219 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:11.200090 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-51a1b0f8-5895-49b0-a350-a91b6ef71598 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbca77c10>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:11.250624 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-51a1b0f8-5895-49b0-a350-a91b6ef71598 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5" status: 200 len: 286 microversion: 2.1 time: 0.055883 May 10 16:48:11.251317 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 11/16] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 10 16:48:11 2022] GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:12.198961 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-359e04e1-c3b3-4a93-afca-162f10c27aa2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:12.199599 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-359e04e1-c3b3-4a93-afca-162f10c27aa2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:12.213938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-359e04e1-c3b3-4a93-afca-162f10c27aa2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:12.214400 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-359e04e1-c3b3-4a93-afca-162f10c27aa2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.215201 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-359e04e1-c3b3-4a93-afca-162f10c27aa2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:12.215650 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-359e04e1-c3b3-4a93-afca-162f10c27aa2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.346993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-359e04e1-c3b3-4a93-afca-162f10c27aa2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:12.360682 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-359e04e1-c3b3-4a93-afca-162f10c27aa2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1211 microversion: 2.1 time: 0.165357 May 10 16:48:12.361578 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 12/17] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:12 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1211 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:12.368805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-21b93c98-1d80-453f-9c45-3acb0422b9d8 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbca7c4c0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:12.432544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-21b93c98-1d80-453f-9c45-3acb0422b9d8 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] HTTP exception thrown: Snapshot 3b121290-db51-4674-810b-bc1799b123b5 could not be found. May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-21b93c98-1d80-453f-9c45-3acb0422b9d8 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Request method failure captured: May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5 HTTP/1.1 May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepc_C51EZa_dYHgSsbwkMftgvvJ85c_tQLa_ZpGm7N6xvQ4TMhLCNgSexD-LviVnZ1dMkmuETP7kLLiUZKAOtJprpIZ1Yc2-aaVOuxiDl40UhNDVcxtjsFHBTwPVdYI9-ohi9Ps-sSz8zYvAKtd30wrrDquPA06LETnNfcGeRcLdV0A May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 8e5268ab3fcf4ec1a112f8e76dbeccd7 May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:48:12.437021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 8e5268ab3fcf4ec1a112f8e76dbeccd7 May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-VolumesSnapshotsTestJSON-885882109-project May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 2d53bca1bae04b9c973fee7f05a2648b May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-VolumesSnapshotsTestJSON-885882109-project May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Snapshot 3b121290-db51-4674-810b-bc1799b123b5 could not be found. May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '3b121290-db51-4674-810b-bc1799b123b5'} May 10 16:48:12.438216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3b121290-db51-4674-810b-bc1799b123b5 could not be found. (HTTP 404) (Request-ID: req-1ec9654b-985f-42ca-a727-f97a31389479) May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.438924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:48:12.439845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3b121290-db51-4674-810b-bc1799b123b5 could not be found. May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 16:48:12.441095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3b121290-db51-4674-810b-bc1799b123b5 could not be found. May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3b121290-db51-4674-810b-bc1799b123b5 could not be found. May 10 16:48:12.442188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.444955 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-21b93c98-1d80-453f-9c45-3acb0422b9d8 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Returning 404 to user: Snapshot 3b121290-db51-4674-810b-bc1799b123b5 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:48:12.447076 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-21b93c98-1d80-453f-9c45-3acb0422b9d8 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5" status: 404 len: 111 microversion: 2.1 time: 0.084385 May 10 16:48:12.448027 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 13/18] 10.222.0.48 () {58 vars in 1250 bytes} [Tue May 10 16:48:12 2022] GET /compute/v2.1/os-snapshots/3b121290-db51-4674-810b-bc1799b123b5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:48:12.460848 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-46abb7a8-9130-4f24-81db-f275ec1d65c6 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbd093f70>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:12.706473 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-46abb7a8-9130-4f24-81db-f275ec1d65c6 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb" status: 202 len: 0 microversion: 2.1 time: 0.253941 May 10 16:48:12.707297 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 14/19] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 10 16:48:12 2022] DELETE /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 16:48:12.717103 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-819a24cb-bcc2-4b46-a8b5-88d71ba93122 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbca7c3a0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:12.801915 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:48:12.802523 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:48:12.803050 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:48:12.803535 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:48:12.805131 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:48:12.817422 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:12.818038 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.818899 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:12.819443 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.859185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Getting quotas for project f6208c73932343aeae12d8cd0983fc77. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:48:12.876844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Getting quotas for user 4de0f4da2d2e464fb9501fa58e344bed and project f6208c73932343aeae12d8cd0983fc77. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:48:12.921207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-819a24cb-bcc2-4b46-a8b5-88d71ba93122 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] HTTP exception thrown: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-819a24cb-bcc2-4b46-a8b5-88d71ba93122 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Request method failure captured: May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb HTTP/1.1 May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepc_C51EZa_dYHgSsbwkMftgvvJ85c_tQLa_ZpGm7N6xvQ4TMhLCNgSexD-LviVnZ1dMkmuETP7kLLiUZKAOtJprpIZ1Yc2-aaVOuxiDl40UhNDVcxtjsFHBTwPVdYI9-ohi9Ps-sSz8zYvAKtd30wrrDquPA06LETnNfcGeRcLdV0A May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 8e5268ab3fcf4ec1a112f8e76dbeccd7 May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:48:12.923377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 8e5268ab3fcf4ec1a112f8e76dbeccd7 May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-VolumesSnapshotsTestJSON-885882109-project May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 2d53bca1bae04b9c973fee7f05a2648b May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-VolumesSnapshotsTestJSON-885882109-project May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '4bd6ecae-cf73-4708-b814-979b5cb5eaeb'} May 10 16:48:12.924494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. (HTTP 404) (Request-ID: req-8c62c0f6-9905-4132-aaa0-f87f8523ac02) May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:12.925146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:48:12.926057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 16:48:12.927221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-819a24cb-bcc2-4b46-a8b5-88d71ba93122 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Returning 404 to user: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-819a24cb-bcc2-4b46-a8b5-88d71ba93122 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb" status: 404 len: 109 microversion: 2.1 time: 0.211810 May 10 16:48:12.931147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 15/20] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:48:12 2022] GET /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb => generated 109 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:48:12.940949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:48:12.944574 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:48:12.948239 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f3d102ff-aee2-4495-8101-545202a8df10 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbca4f160>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:13.100138 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f6309946-3580-4053-b899-b1a6b581044a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.143430 May 10 16:48:13.108964 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 6/21] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:48:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:48:13.119435 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5b7b2d5e-5379-4a84-a169-68371eda2424 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:13.120683 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5b7b2d5e-5379-4a84-a169-68371eda2424 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:13.473897 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-f3d102ff-aee2-4495-8101-545202a8df10 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] HTTP exception thrown: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f3d102ff-aee2-4495-8101-545202a8df10 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Request method failure captured: May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: DELETE /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb HTTP/1.1 May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepc_C51EZa_dYHgSsbwkMftgvvJ85c_tQLa_ZpGm7N6xvQ4TMhLCNgSexD-LviVnZ1dMkmuETP7kLLiUZKAOtJprpIZ1Yc2-aaVOuxiDl40UhNDVcxtjsFHBTwPVdYI9-ohi9Ps-sSz8zYvAKtd30wrrDquPA06LETnNfcGeRcLdV0A May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 8e5268ab3fcf4ec1a112f8e76dbeccd7 May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:48:13.479894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 8e5268ab3fcf4ec1a112f8e76dbeccd7 May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-VolumesSnapshotsTestJSON-885882109-project May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 2d53bca1bae04b9c973fee7f05a2648b May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-VolumesSnapshotsTestJSON-885882109-project May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '4bd6ecae-cf73-4708-b814-979b5cb5eaeb'} May 10 16:48:13.481059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. (HTTP 404) (Request-ID: req-960c6421-a584-4ad8-a098-eb259cebcfaa) May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:13.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:48:13.485712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 16:48:13.486593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f3d102ff-aee2-4495-8101-545202a8df10 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Returning 404 to user: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f3d102ff-aee2-4495-8101-545202a8df10 tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb" status: 404 len: 109 microversion: 2.1 time: 0.538371 May 10 16:48:13.487630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 16/22] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 10 16:48:12 2022] DELETE /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb => generated 109 bytes in 541 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:48:13.494637 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-18dee76d-8ce4-475a-bb77-63e1590536b1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:13.508551 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-18dee76d-8ce4-475a-bb77-63e1590536b1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:13.555911 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18dee76d-8ce4-475a-bb77-63e1590536b1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:13.573107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18dee76d-8ce4-475a-bb77-63e1590536b1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:13.578793 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18dee76d-8ce4-475a-bb77-63e1590536b1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:13.582456 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18dee76d-8ce4-475a-bb77-63e1590536b1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:13.594468 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-5b7b2d5e-5379-4a84-a169-68371eda2424 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:13.638105 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-5b7b2d5e-5379-4a84-a169-68371eda2424 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1222 microversion: 2.1 time: 0.501329 May 10 16:48:13.648951 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 7/23] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:13 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1222 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:13.675019 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8ef2f23d-eee4-40e3-b1bf-7bc920cf281e tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Calling method '.version_select at 0x7f5fbc249430>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:13.781691 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-8ef2f23d-eee4-40e3-b1bf-7bc920cf281e tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] HTTP exception thrown: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8ef2f23d-eee4-40e3-b1bf-7bc920cf281e tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Request method failure captured: May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb HTTP/1.1 May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepc_C51EZa_dYHgSsbwkMftgvvJ85c_tQLa_ZpGm7N6xvQ4TMhLCNgSexD-LviVnZ1dMkmuETP7kLLiUZKAOtJprpIZ1Yc2-aaVOuxiDl40UhNDVcxtjsFHBTwPVdYI9-ohi9Ps-sSz8zYvAKtd30wrrDquPA06LETnNfcGeRcLdV0A May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: 8e5268ab3fcf4ec1a112f8e76dbeccd7 May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:48:13.786628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8e5268ab3fcf4ec1a112f8e76dbeccd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: 8e5268ab3fcf4ec1a112f8e76dbeccd7 May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-885882109 May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-VolumesSnapshotsTestJSON-885882109-project May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 2d53bca1bae04b9c973fee7f05a2648b May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-VolumesSnapshotsTestJSON-885882109-project May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '4bd6ecae-cf73-4708-b814-979b5cb5eaeb'} May 10 16:48:13.787974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. (HTTP 404) (Request-ID: req-b2d9562c-36ad-4c9c-b4dd-1bc82321cc41) May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:13.788784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:48:13.793295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 16:48:13.794352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8ef2f23d-eee4-40e3-b1bf-7bc920cf281e tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] Returning 404 to user: Volume 4bd6ecae-cf73-4708-b814-979b5cb5eaeb could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8ef2f23d-eee4-40e3-b1bf-7bc920cf281e tempest-VolumesSnapshotsTestJSON-885882109 tempest-VolumesSnapshotsTestJSON-885882109-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb" status: 404 len: 109 microversion: 2.1 time: 0.137638 May 10 16:48:13.795361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 8/24] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:48:13 2022] GET /compute/v2.1/os-volumes/4bd6ecae-cf73-4708-b814-979b5cb5eaeb => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:48:14.112177 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6218ae3b-62b2-4339-80d6-eb316463771a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Action: 'create', calling method: .version_select at 0x7f5fbc1e0670>, body: {"keypair": {"name": "tempest-keypair-897707862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8HXzWpL9pqbAFyHZfYFUwSHg0IK77LP8yKGcRZUSXaCpgJCRHXqhhtKM3sd5so5/uEpu9mNPSCHQJ4fNx9iVcCgRO/QEIXh9v5S3mm//VCFB+MNxYPyiaEb4F9q5o4bA=="}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:14.165662 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-6218ae3b-62b2-4339-80d6-eb316463771a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Getting quotas for project a26f2126d1804c3caf0f83a1eb47fbff. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:48:14.185329 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-6218ae3b-62b2-4339-80d6-eb316463771a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Getting quotas for user 25229d5ef3be47988accfdee5f9209b8 and project a26f2126d1804c3caf0f83a1eb47fbff. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:48:14.363352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6218ae3b-62b2-4339-80d6-eb316463771a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.496130 May 10 16:48:14.375837 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 9/25] 10.222.0.48 () {62 vars in 1199 bytes} [Tue May 10 16:48:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 509 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 16:48:14.393038 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2099222394", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:14.474439 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] validate_networks() for [('5732deb1-fb33-4f08-9ad5-7d92102702ad', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:48:15.537448 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-18dee76d-8ce4-475a-bb77-63e1590536b1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:15.545575 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-18dee76d-8ce4-475a-bb77-63e1590536b1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1273 microversion: 2.1 time: 2.059129 May 10 16:48:15.555174 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 17/26] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:13 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1273 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:16.112466 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:48:16.114674 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:48:16.115547 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:48:16.116139 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:48:16.116753 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:48:16.141844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:16.142845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:16.147105 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:16.161460 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:16.246678 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Getting quotas for project f6208c73932343aeae12d8cd0983fc77. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:48:16.257143 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Getting quotas for user 4de0f4da2d2e464fb9501fa58e344bed and project f6208c73932343aeae12d8cd0983fc77. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:48:16.288455 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:48:16.292425 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:48:16.435094 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b3315bab-3f37-40bc-ad1a-8f1da5e3bf7a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.057627 May 10 16:48:16.442123 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 10/27] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:48:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:48:16.447011 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f782ed24-bc94-4d80-a51f-9f43f81a0d6a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:16.447633 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f782ed24-bc94-4d80-a51f-9f43f81a0d6a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:16.580683 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c55bffba-bd63-4c15-8345-9b997de5fdbc tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:16.581351 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c55bffba-bd63-4c15-8345-9b997de5fdbc tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:16.633663 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c55bffba-bd63-4c15-8345-9b997de5fdbc tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:16.636870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c55bffba-bd63-4c15-8345-9b997de5fdbc tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:16.642707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c55bffba-bd63-4c15-8345-9b997de5fdbc tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:16.643429 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c55bffba-bd63-4c15-8345-9b997de5fdbc tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:16.682543 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f782ed24-bc94-4d80-a51f-9f43f81a0d6a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:16.713979 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f782ed24-bc94-4d80-a51f-9f43f81a0d6a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1222 microversion: 2.1 time: 0.270243 May 10 16:48:16.717341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 18/28] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:16 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1222 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:17.346312 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c55bffba-bd63-4c15-8345-9b997de5fdbc tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:17.387836 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c55bffba-bd63-4c15-8345-9b997de5fdbc tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.818487 May 10 16:48:17.389364 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 11/29] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:16 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:17.681458 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-cc37e46f-a882-4926-b2c5-9c63f3b711e4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'create', calling method: .version_select at 0x7f5fbc9bc1f0>, body: {"keypair": {"name": "tempest-keypair-2065765841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFQ89X0w0SmGZ0ctPQZPtO3hcdQLmeqKlPO4gk9GyGN/WMKTXvyIvAkKHnKDer7m0NsReB2UJfBPtPeJgJEdKfua/YEKC6iJ0sMBStaBAVopu0wDo1vTcczXFtvgZMGIA=="}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:17.734957 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-29d4b545-7dfa-4b57-b84e-89df39791f11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:17.735778 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-29d4b545-7dfa-4b57-b84e-89df39791f11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:17.750746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-29d4b545-7dfa-4b57-b84e-89df39791f11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:17.751394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-29d4b545-7dfa-4b57-b84e-89df39791f11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:17.761041 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-29d4b545-7dfa-4b57-b84e-89df39791f11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:17.761527 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-29d4b545-7dfa-4b57-b84e-89df39791f11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:17.796486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-cc37e46f-a882-4926-b2c5-9c63f3b711e4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Getting quotas for project 6c526b65f8454d7e84b29236f42417f7. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:48:17.805659 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-cc37e46f-a882-4926-b2c5-9c63f3b711e4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Getting quotas for user e2a00f1a578d44abadaa39db5235363a and project 6c526b65f8454d7e84b29236f42417f7. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:48:17.899522 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-29d4b545-7dfa-4b57-b84e-89df39791f11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:17.905709 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-cc37e46f-a882-4926-b2c5-9c63f3b711e4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.014479 May 10 16:48:17.910090 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-29d4b545-7dfa-4b57-b84e-89df39791f11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1226 microversion: 2.1 time: 0.178918 May 10 16:48:17.912650 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 12/30] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:17 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1226 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:17.936097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 19/31] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 10 16:48:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:18.412870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e56bdba0-2524-4acf-9b53-0d70c3fd380e tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:18.413990 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e56bdba0-2524-4acf-9b53-0d70c3fd380e tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:18.438915 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e56bdba0-2524-4acf-9b53-0d70c3fd380e tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:18.459185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e56bdba0-2524-4acf-9b53-0d70c3fd380e tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:18.470240 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e56bdba0-2524-4acf-9b53-0d70c3fd380e tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:18.470951 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e56bdba0-2524-4acf-9b53-0d70c3fd380e tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:18.932195 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4d034a73-1888-433e-a918-9910edf25ffa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:18.933835 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4d034a73-1888-433e-a918-9910edf25ffa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:18.952823 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4d034a73-1888-433e-a918-9910edf25ffa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:18.952823 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4d034a73-1888-433e-a918-9910edf25ffa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:18.952823 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4d034a73-1888-433e-a918-9910edf25ffa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:18.958379 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4d034a73-1888-433e-a918-9910edf25ffa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:19.400644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4d034a73-1888-433e-a918-9910edf25ffa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:19.417471 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4d034a73-1888-433e-a918-9910edf25ffa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1226 microversion: 2.1 time: 0.488467 May 10 16:48:19.425558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 20/32] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:18 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1226 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:19.612453 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e56bdba0-2524-4acf-9b53-0d70c3fd380e tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:19.638466 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e56bdba0-2524-4acf-9b53-0d70c3fd380e tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 1.236220 May 10 16:48:19.649817 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 13/33] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:18 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:20.442438 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-876eb78e-9d20-4f0c-9d5d-a8540b3700f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:20.443088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-876eb78e-9d20-4f0c-9d5d-a8540b3700f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:20.455527 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-876eb78e-9d20-4f0c-9d5d-a8540b3700f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:20.456039 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-876eb78e-9d20-4f0c-9d5d-a8540b3700f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:20.457142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-876eb78e-9d20-4f0c-9d5d-a8540b3700f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:20.458608 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-876eb78e-9d20-4f0c-9d5d-a8540b3700f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:20.665174 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-21bc1ff8-d189-4866-a7ca-3d8140cda45f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:20.665948 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-21bc1ff8-d189-4866-a7ca-3d8140cda45f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:20.695629 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21bc1ff8-d189-4866-a7ca-3d8140cda45f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:20.699876 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21bc1ff8-d189-4866-a7ca-3d8140cda45f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:20.700910 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21bc1ff8-d189-4866-a7ca-3d8140cda45f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:20.712834 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21bc1ff8-d189-4866-a7ca-3d8140cda45f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:21.150654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-876eb78e-9d20-4f0c-9d5d-a8540b3700f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:21.189034 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-876eb78e-9d20-4f0c-9d5d-a8540b3700f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1274 microversion: 2.1 time: 0.749172 May 10 16:48:21.192501 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 21/34] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:20 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1274 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:22.220680 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ac58ac1a-567b-4ef2-894a-010480b79211 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:22.221399 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ac58ac1a-567b-4ef2-894a-010480b79211 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:22.229769 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ac58ac1a-567b-4ef2-894a-010480b79211 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:22.237608 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ac58ac1a-567b-4ef2-894a-010480b79211 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:22.242702 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ac58ac1a-567b-4ef2-894a-010480b79211 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:22.244406 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ac58ac1a-567b-4ef2-894a-010480b79211 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:23.034442 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-21bc1ff8-d189-4866-a7ca-3d8140cda45f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:23.045035 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-21bc1ff8-d189-4866-a7ca-3d8140cda45f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 2.384656 May 10 16:48:23.068754 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 14/35] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:20 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 2408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:23.400553 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ac58ac1a-567b-4ef2-894a-010480b79211 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:23.426121 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ac58ac1a-567b-4ef2-894a-010480b79211 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1280 microversion: 2.1 time: 1.204413 May 10 16:48:23.430194 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 22/36] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:22 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1280 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:24.080081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-24c6577b-2cb4-4285-8964-082cb10f7d9f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:24.080808 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-24c6577b-2cb4-4285-8964-082cb10f7d9f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:24.096368 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-24c6577b-2cb4-4285-8964-082cb10f7d9f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:24.105555 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-24c6577b-2cb4-4285-8964-082cb10f7d9f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:24.106812 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-24c6577b-2cb4-4285-8964-082cb10f7d9f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:24.109931 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-24c6577b-2cb4-4285-8964-082cb10f7d9f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:24.451237 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-53bcec3c-982a-4591-8b23-3a80d6d664af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:24.452300 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-53bcec3c-982a-4591-8b23-3a80d6d664af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:24.477589 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-53bcec3c-982a-4591-8b23-3a80d6d664af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:24.478109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-53bcec3c-982a-4591-8b23-3a80d6d664af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:24.489370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-53bcec3c-982a-4591-8b23-3a80d6d664af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:24.489861 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-53bcec3c-982a-4591-8b23-3a80d6d664af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:24.906016 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-53bcec3c-982a-4591-8b23-3a80d6d664af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:24.933384 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-53bcec3c-982a-4591-8b23-3a80d6d664af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1280 microversion: 2.1 time: 0.486412 May 10 16:48:24.935098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 23/37] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:24 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1280 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:25.684816 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-24c6577b-2cb4-4285-8964-082cb10f7d9f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:25.700309 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-24c6577b-2cb4-4285-8964-082cb10f7d9f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 1.631801 May 10 16:48:25.714617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 15/38] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:24 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:25.954421 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ce0d4d83-431a-4a04-9651-feaabf9fd570 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:25.955065 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ce0d4d83-431a-4a04-9651-feaabf9fd570 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:25.966712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ce0d4d83-431a-4a04-9651-feaabf9fd570 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:25.969276 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ce0d4d83-431a-4a04-9651-feaabf9fd570 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:25.973125 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ce0d4d83-431a-4a04-9651-feaabf9fd570 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:25.977558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ce0d4d83-431a-4a04-9651-feaabf9fd570 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:26.027218 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-90250520-0373-4c29-95f8-952e189fc527 req-7f56889f-851e-42ae-bbf0-2a50b9ff0b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0c17d0-fd7d-4f22-a89c-bc390a1cc535", "tag": "49626576-c69c-48d0-8b3d-be4360ede3a8"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:26.053657 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-90250520-0373-4c29-95f8-952e189fc527 req-7f56889f-851e-42ae-bbf0-2a50b9ff0b76 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:26.055937 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-90250520-0373-4c29-95f8-952e189fc527 req-7f56889f-851e-42ae-bbf0-2a50b9ff0b76 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:26.106203 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-90250520-0373-4c29-95f8-952e189fc527 req-7f56889f-851e-42ae-bbf0-2a50b9ff0b76 service nova] Creating event network-changed:49626576-c69c-48d0-8b3d-be4360ede3a8 for instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 on hv-cinder-83588 May 10 16:48:26.108586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-90250520-0373-4c29-95f8-952e189fc527 req-7f56889f-851e-42ae-bbf0-2a50b9ff0b76 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134195) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 16:48:26.111667 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5cf1b19a-c870-46fb-96ce-e4a49a190956 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:26.113049 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5cf1b19a-c870-46fb-96ce-e4a49a190956 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:26.115442 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5cf1b19a-c870-46fb-96ce-e4a49a190956 None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:26.116555 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5cf1b19a-c870-46fb-96ce-e4a49a190956 None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:26.136019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.compute.rpcapi [None req-5cf1b19a-c870-46fb-96ce-e4a49a190956 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 16:48:26.140046 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5cf1b19a-c870-46fb-96ce-e4a49a190956 None None] Releasing lock "compute-rpcapi-router" {{(pid=134195) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 16:48:26.193367 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ce0d4d83-431a-4a04-9651-feaabf9fd570 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:26.204102 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5cf1b19a-c870-46fb-96ce-e4a49a190956 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371567 May 10 16:48:26.205038 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 24/39] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:26.214273 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2112331933", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90344bc1-cc22-4179-9584-f0a07adf617d"}], "security_groups": [{"name": "tempest-securitygroup--1294654647"}], "key_name": "tempest-keypair-897707862", "user_data": "}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:26.220447 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ce0d4d83-431a-4a04-9651-feaabf9fd570 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1280 microversion: 2.1 time: 0.272378 May 10 16:48:26.221035 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 16/40] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:25 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1280 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:26.721330 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9dc8e622-c5c5-4b42-9965-210e2e3d80ec tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:26.722256 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9dc8e622-c5c5-4b42-9965-210e2e3d80ec tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:26.748846 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9dc8e622-c5c5-4b42-9965-210e2e3d80ec tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:26.753240 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9dc8e622-c5c5-4b42-9965-210e2e3d80ec tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:26.756933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9dc8e622-c5c5-4b42-9965-210e2e3d80ec tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:26.758497 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9dc8e622-c5c5-4b42-9965-210e2e3d80ec tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:27.386980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9dc8e622-c5c5-4b42-9965-210e2e3d80ec tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:27.415863 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9dc8e622-c5c5-4b42-9965-210e2e3d80ec tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.698251 May 10 16:48:27.421933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 17/41] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:26 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:27.456675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-51713728-b1c7-4a4f-bb04-d6a583fdb3c8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:27.462297 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-51713728-b1c7-4a4f-bb04-d6a583fdb3c8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:27.497456 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-51713728-b1c7-4a4f-bb04-d6a583fdb3c8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:27.497456 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-51713728-b1c7-4a4f-bb04-d6a583fdb3c8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:27.501672 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-51713728-b1c7-4a4f-bb04-d6a583fdb3c8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:27.507091 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-51713728-b1c7-4a4f-bb04-d6a583fdb3c8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:27.579665 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.network.neutron [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] validate_networks() for [('90344bc1-cc22-4179-9584-f0a07adf617d', None, None, None, None, None)] {{(pid=134195) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:48:28.500633 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-51713728-b1c7-4a4f-bb04-d6a583fdb3c8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:28.514574 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-51713728-b1c7-4a4f-bb04-d6a583fdb3c8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 1.089983 May 10 16:48:28.515247 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 18/42] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:27 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:28.548398 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-777268998", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a644c79f-3db2-4028-a56c-6b5bff2a3f86"}], "security_groups": [{"name": "tempest-securitygroup--672584514"}], "key_name": "tempest-keypair-2065765841", "user_data": "}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:28.829810 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] validate_networks() for [('a644c79f-3db2-4028-a56c-6b5bff2a3f86', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:48:30.232131 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:48:30.232813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:48:30.233295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:48:30.233838 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:48:30.234369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:48:30.249995 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:30.256932 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:30.258490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:30.260881 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:30.316589 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Getting quotas for project 6c526b65f8454d7e84b29236f42417f7. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:48:30.324702 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Getting quotas for user e2a00f1a578d44abadaa39db5235363a and project 6c526b65f8454d7e84b29236f42417f7. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:48:30.358675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:48:30.367247 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:48:30.478720 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cf272122-2291-4088-9226-8d36204fd4db tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.956586 May 10 16:48:30.479959 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 19/43] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:48:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:48:30.526800 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0ea7bcca-3779-4174-81af-449bdc939ea3 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:30.529459 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0ea7bcca-3779-4174-81af-449bdc939ea3 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:30.548678 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0ea7bcca-3779-4174-81af-449bdc939ea3 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:30.549265 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0ea7bcca-3779-4174-81af-449bdc939ea3 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:30.550311 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0ea7bcca-3779-4174-81af-449bdc939ea3 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:30.550973 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0ea7bcca-3779-4174-81af-449bdc939ea3 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:30.904564 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Flavor limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:48:30.905093 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Image limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:48:30.906257 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Flavor pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:48:30.906787 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Image pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:48:30.907315 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:48:30.920033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:30.921192 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:30.923469 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:30.924384 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:30.954562 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Getting quotas for project a26f2126d1804c3caf0f83a1eb47fbff. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:48:30.963178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0ea7bcca-3779-4174-81af-449bdc939ea3 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:30.968471 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Getting quotas for user 25229d5ef3be47988accfdee5f9209b8 and project a26f2126d1804c3caf0f83a1eb47fbff. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:48:30.975174 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0ea7bcca-3779-4174-81af-449bdc939ea3 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.493495 May 10 16:48:30.979693 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 20/44] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:30 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:30.988384 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6de3de04-8dc0-4327-bfe0-4957ebfec36a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:30.989012 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6de3de04-8dc0-4327-bfe0-4957ebfec36a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:30.999414 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6de3de04-8dc0-4327-bfe0-4957ebfec36a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:31.000416 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6de3de04-8dc0-4327-bfe0-4957ebfec36a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:31.001782 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6de3de04-8dc0-4327-bfe0-4957ebfec36a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:31.001895 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Going to run 1 instances... {{(pid=134195) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:48:31.002502 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6de3de04-8dc0-4327-bfe0-4957ebfec36a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:31.004767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134195) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:48:31.098412 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a275f24c-6cc9-48a4-8126-6dbfe0c464a2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.889951 May 10 16:48:31.099828 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 25/45] 10.222.0.48 () {62 vars in 1187 bytes} [Tue May 10 16:48:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 4894 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 16:48:31.114117 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-79dd0342-4a30-4bc3-ab16-d931ed17958f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:31.115094 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-79dd0342-4a30-4bc3-ab16-d931ed17958f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:31.184578 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-79dd0342-4a30-4bc3-ab16-d931ed17958f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:31.195971 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-79dd0342-4a30-4bc3-ab16-d931ed17958f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1237 microversion: 2.1 time: 0.084426 May 10 16:48:31.205573 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 26/46] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:31 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1237 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:31.214836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-30a26a7f-349c-4f69-94b4-ba862d78d7d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:31.215566 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-30a26a7f-349c-4f69-94b4-ba862d78d7d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:31.294625 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-30a26a7f-349c-4f69-94b4-ba862d78d7d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:31.304204 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-30a26a7f-349c-4f69-94b4-ba862d78d7d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:31.338457 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-30a26a7f-349c-4f69-94b4-ba862d78d7d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:31.340476 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-30a26a7f-349c-4f69-94b4-ba862d78d7d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1281 microversion: 2.20 time: 0.133129 May 10 16:48:31.341303 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 27/47] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:31 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1281 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:31.387865 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6de3de04-8dc0-4327-bfe0-4957ebfec36a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:31.396845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6de3de04-8dc0-4327-bfe0-4957ebfec36a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.415934 May 10 16:48:31.406162 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 21/48] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:30 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:31.993384 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f864ef6e-55c2-4050-8b21-c9a1f2b5933a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:31.994693 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f864ef6e-55c2-4050-8b21-c9a1f2b5933a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:32.001495 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f864ef6e-55c2-4050-8b21-c9a1f2b5933a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:32.001715 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-752f647a-d082-44af-88ef-278f6482c451 req-e14f3ef9-c1eb-4d87-b6c3-16fce5fe03ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec359fa-52db-434d-8b29-f0d796faf8c0", "tag": "9159b071-bf14-4943-ad14-db670af07144"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:32.002181 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f864ef6e-55c2-4050-8b21-c9a1f2b5933a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:32.002738 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f864ef6e-55c2-4050-8b21-c9a1f2b5933a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:32.003172 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f864ef6e-55c2-4050-8b21-c9a1f2b5933a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:32.025229 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-752f647a-d082-44af-88ef-278f6482c451 req-e14f3ef9-c1eb-4d87-b6c3-16fce5fe03ce service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:32.025720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-752f647a-d082-44af-88ef-278f6482c451 req-e14f3ef9-c1eb-4d87-b6c3-16fce5fe03ce service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:32.048916 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-752f647a-d082-44af-88ef-278f6482c451 req-e14f3ef9-c1eb-4d87-b6c3-16fce5fe03ce service nova] Creating event network-changed:9159b071-bf14-4943-ad14-db670af07144 for instance dec359fa-52db-434d-8b29-f0d796faf8c0 on hv-cinder-83588 May 10 16:48:32.057590 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-752f647a-d082-44af-88ef-278f6482c451 req-e14f3ef9-c1eb-4d87-b6c3-16fce5fe03ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179991 May 10 16:48:32.058475 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 28/49] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:48:32.216735 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-73b0ce04-71fb-43ae-ae05-26b7296a332b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:32.218219 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-73b0ce04-71fb-43ae-ae05-26b7296a332b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:32.261282 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73b0ce04-71fb-43ae-ae05-26b7296a332b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:32.261881 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73b0ce04-71fb-43ae-ae05-26b7296a332b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:32.266014 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73b0ce04-71fb-43ae-ae05-26b7296a332b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:32.266490 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73b0ce04-71fb-43ae-ae05-26b7296a332b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:32.442922 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-73b0ce04-71fb-43ae-ae05-26b7296a332b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:32.462537 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-73b0ce04-71fb-43ae-ae05-26b7296a332b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1233 microversion: 2.1 time: 0.249060 May 10 16:48:32.463190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 29/50] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:32 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1233 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:32.464075 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f864ef6e-55c2-4050-8b21-c9a1f2b5933a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:32.471678 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f864ef6e-55c2-4050-8b21-c9a1f2b5933a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.482992 May 10 16:48:32.477161 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 22/51] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:31 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:32.494145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-eb71c8a7-a520-4cd9-906d-c32781f5446e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:32.494760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-eb71c8a7-a520-4cd9-906d-c32781f5446e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:32.500558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e5159c8c-c22c-4e24-a9f7-ce349e73cb89 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:32.501352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e5159c8c-c22c-4e24-a9f7-ce349e73cb89 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:32.514315 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5159c8c-c22c-4e24-a9f7-ce349e73cb89 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:32.515145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5159c8c-c22c-4e24-a9f7-ce349e73cb89 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:32.516190 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5159c8c-c22c-4e24-a9f7-ce349e73cb89 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:32.516888 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5159c8c-c22c-4e24-a9f7-ce349e73cb89 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:32.520234 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb71c8a7-a520-4cd9-906d-c32781f5446e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:32.521073 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb71c8a7-a520-4cd9-906d-c32781f5446e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:32.525924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb71c8a7-a520-4cd9-906d-c32781f5446e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:32.527064 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb71c8a7-a520-4cd9-906d-c32781f5446e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:32.731768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-eb71c8a7-a520-4cd9-906d-c32781f5446e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:32.764245 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-eb71c8a7-a520-4cd9-906d-c32781f5446e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:32.767152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-eb71c8a7-a520-4cd9-906d-c32781f5446e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:32.793976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-eb71c8a7-a520-4cd9-906d-c32781f5446e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1277 microversion: 2.20 time: 0.318233 May 10 16:48:32.795027 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 30/52] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:32 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:33.291438 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e5159c8c-c22c-4e24-a9f7-ce349e73cb89 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:33.319081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e5159c8c-c22c-4e24-a9f7-ce349e73cb89 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.840257 May 10 16:48:33.324997 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 23/53] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:32 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:33.480303 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7aee1c56-0aba-4fb1-8162-b15c6f8acbb6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:33.481160 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7aee1c56-0aba-4fb1-8162-b15c6f8acbb6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:33.493723 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7aee1c56-0aba-4fb1-8162-b15c6f8acbb6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:33.494347 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7aee1c56-0aba-4fb1-8162-b15c6f8acbb6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:33.498711 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c3682194-f1a4-4b9a-8a0e-2902626353cd tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:33.500679 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c3682194-f1a4-4b9a-8a0e-2902626353cd tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:33.501432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7aee1c56-0aba-4fb1-8162-b15c6f8acbb6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:33.501907 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7aee1c56-0aba-4fb1-8162-b15c6f8acbb6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:33.512624 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c3682194-f1a4-4b9a-8a0e-2902626353cd tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:33.513510 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c3682194-f1a4-4b9a-8a0e-2902626353cd tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:33.515270 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c3682194-f1a4-4b9a-8a0e-2902626353cd tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:33.516965 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c3682194-f1a4-4b9a-8a0e-2902626353cd tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:33.739888 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7aee1c56-0aba-4fb1-8162-b15c6f8acbb6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:33.751891 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7aee1c56-0aba-4fb1-8162-b15c6f8acbb6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1289 microversion: 2.1 time: 0.274376 May 10 16:48:33.765555 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 31/54] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:33 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1289 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:33.813646 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-34636f4a-24d8-45ea-ba68-7e13847fa73d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:33.814527 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-34636f4a-24d8-45ea-ba68-7e13847fa73d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:33.816628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c3682194-f1a4-4b9a-8a0e-2902626353cd tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:33.832787 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c3682194-f1a4-4b9a-8a0e-2902626353cd tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.338634 May 10 16:48:33.832787 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 24/55] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:33 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:33.835562 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34636f4a-24d8-45ea-ba68-7e13847fa73d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:33.836201 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34636f4a-24d8-45ea-ba68-7e13847fa73d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:33.837384 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34636f4a-24d8-45ea-ba68-7e13847fa73d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:33.840861 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34636f4a-24d8-45ea-ba68-7e13847fa73d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:34.005343 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-34636f4a-24d8-45ea-ba68-7e13847fa73d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:34.019607 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-34636f4a-24d8-45ea-ba68-7e13847fa73d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:34.021188 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-e9fd55a4-10bd-4073-8622-0f9cd99f38e0 req-7e02fa5e-96af-4185-b2c3-9cf8ddf81b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82b30ce-5490-4df6-8d9e-12bf93154ae8", "tag": "2e36c520-ea08-4d13-beae-c69470ab57c8"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:34.021813 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-34636f4a-24d8-45ea-ba68-7e13847fa73d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:34.023446 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-34636f4a-24d8-45ea-ba68-7e13847fa73d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1333 microversion: 2.20 time: 0.213875 May 10 16:48:34.024233 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 32/56] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:33 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1333 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:34.043111 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-e9fd55a4-10bd-4073-8622-0f9cd99f38e0 req-7e02fa5e-96af-4185-b2c3-9cf8ddf81b32 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:34.043796 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-e9fd55a4-10bd-4073-8622-0f9cd99f38e0 req-7e02fa5e-96af-4185-b2c3-9cf8ddf81b32 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:34.082530 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-e9fd55a4-10bd-4073-8622-0f9cd99f38e0 req-7e02fa5e-96af-4185-b2c3-9cf8ddf81b32 service nova] Creating event network-changed:2e36c520-ea08-4d13-beae-c69470ab57c8 for instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 on hv-cinder-83588 May 10 16:48:34.084090 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-e9fd55a4-10bd-4073-8622-0f9cd99f38e0 req-7e02fa5e-96af-4185-b2c3-9cf8ddf81b32 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134194) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 16:48:34.086237 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d6d15c00-eed3-425f-a7db-7c3a5748e096 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:34.086940 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d6d15c00-eed3-425f-a7db-7c3a5748e096 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:34.089717 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d6d15c00-eed3-425f-a7db-7c3a5748e096 None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:34.090459 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d6d15c00-eed3-425f-a7db-7c3a5748e096 None None] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:34.112430 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.compute.rpcapi [None req-d6d15c00-eed3-425f-a7db-7c3a5748e096 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 16:48:34.114571 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d6d15c00-eed3-425f-a7db-7c3a5748e096 None None] Releasing lock "compute-rpcapi-router" {{(pid=134194) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 16:48:34.134398 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d6d15c00-eed3-425f-a7db-7c3a5748e096 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118021 May 10 16:48:34.135405 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 25/57] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:34.344167 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-760b8af0-9ea8-499e-bfef-f22f1d2e5c7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:34.345210 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-760b8af0-9ea8-499e-bfef-f22f1d2e5c7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:34.354625 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-760b8af0-9ea8-499e-bfef-f22f1d2e5c7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:34.356049 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-760b8af0-9ea8-499e-bfef-f22f1d2e5c7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:34.357980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-760b8af0-9ea8-499e-bfef-f22f1d2e5c7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:34.358783 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-760b8af0-9ea8-499e-bfef-f22f1d2e5c7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:34.559977 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-760b8af0-9ea8-499e-bfef-f22f1d2e5c7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:34.577529 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-760b8af0-9ea8-499e-bfef-f22f1d2e5c7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.238559 May 10 16:48:34.579515 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 33/58] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:34 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:34.781270 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-86b00f64-5434-46e7-8001-ee72def7ccf3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:34.782203 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-86b00f64-5434-46e7-8001-ee72def7ccf3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:34.791058 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-86b00f64-5434-46e7-8001-ee72def7ccf3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:34.791711 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-86b00f64-5434-46e7-8001-ee72def7ccf3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:34.792842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-86b00f64-5434-46e7-8001-ee72def7ccf3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:34.793402 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-86b00f64-5434-46e7-8001-ee72def7ccf3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:34.852196 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2bc41562-7a1c-4224-b2eb-8728c6130fc1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:34.853130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2bc41562-7a1c-4224-b2eb-8728c6130fc1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:34.859957 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2bc41562-7a1c-4224-b2eb-8728c6130fc1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:34.860649 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2bc41562-7a1c-4224-b2eb-8728c6130fc1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:34.861600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2bc41562-7a1c-4224-b2eb-8728c6130fc1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:34.862187 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2bc41562-7a1c-4224-b2eb-8728c6130fc1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:34.894272 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-86b00f64-5434-46e7-8001-ee72def7ccf3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:34.910398 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-86b00f64-5434-46e7-8001-ee72def7ccf3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1297 microversion: 2.1 time: 0.131104 May 10 16:48:34.926675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 26/59] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:34 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1297 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:35.043124 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-1cb65d31-70da-4882-b65e-90355fb6fe38 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:35.043787 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-1cb65d31-70da-4882-b65e-90355fb6fe38 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:35.053581 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1cb65d31-70da-4882-b65e-90355fb6fe38 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:35.055889 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1cb65d31-70da-4882-b65e-90355fb6fe38 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:35.056840 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1cb65d31-70da-4882-b65e-90355fb6fe38 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:35.057285 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1cb65d31-70da-4882-b65e-90355fb6fe38 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:35.136935 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2bc41562-7a1c-4224-b2eb-8728c6130fc1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:35.145444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2bc41562-7a1c-4224-b2eb-8728c6130fc1 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.298922 May 10 16:48:35.161383 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 34/60] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:34 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:35.169993 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-1cb65d31-70da-4882-b65e-90355fb6fe38 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:35.183299 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-1cb65d31-70da-4882-b65e-90355fb6fe38 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:35.186324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-1cb65d31-70da-4882-b65e-90355fb6fe38 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:35.188023 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-1cb65d31-70da-4882-b65e-90355fb6fe38 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1341 microversion: 2.20 time: 0.149684 May 10 16:48:35.193688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 27/61] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:35 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1341 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:35.596082 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-53342464-6f6d-4da7-b347-8cc057cdb017 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:35.597424 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-53342464-6f6d-4da7-b347-8cc057cdb017 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:35.605220 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-53342464-6f6d-4da7-b347-8cc057cdb017 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:35.605690 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-53342464-6f6d-4da7-b347-8cc057cdb017 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:35.606492 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-53342464-6f6d-4da7-b347-8cc057cdb017 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:35.606937 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-53342464-6f6d-4da7-b347-8cc057cdb017 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:35.934712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6f1c414d-6139-4953-bffc-db6701a7617e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:35.935679 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6f1c414d-6139-4953-bffc-db6701a7617e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:35.942792 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6f1c414d-6139-4953-bffc-db6701a7617e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:35.943248 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6f1c414d-6139-4953-bffc-db6701a7617e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:35.944034 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6f1c414d-6139-4953-bffc-db6701a7617e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:35.944546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6f1c414d-6139-4953-bffc-db6701a7617e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:35.959986 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-53342464-6f6d-4da7-b347-8cc057cdb017 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:35.967982 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-53342464-6f6d-4da7-b347-8cc057cdb017 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.376331 May 10 16:48:35.968602 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 35/62] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:35 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:36.010751 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6f1c414d-6139-4953-bffc-db6701a7617e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:36.018202 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6f1c414d-6139-4953-bffc-db6701a7617e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1295 microversion: 2.1 time: 0.088147 May 10 16:48:36.018812 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 28/63] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:35 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1295 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:36.164242 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b5752e75-b5da-4601-8832-dcb8bdca0d3a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:36.164882 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b5752e75-b5da-4601-8832-dcb8bdca0d3a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:36.171096 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5752e75-b5da-4601-8832-dcb8bdca0d3a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:36.171565 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5752e75-b5da-4601-8832-dcb8bdca0d3a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:36.172453 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5752e75-b5da-4601-8832-dcb8bdca0d3a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:36.172894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5752e75-b5da-4601-8832-dcb8bdca0d3a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:36.211536 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8c52963a-2a25-41f4-aea4-b344e0eae072 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:36.212847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8c52963a-2a25-41f4-aea4-b344e0eae072 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:36.226860 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8c52963a-2a25-41f4-aea4-b344e0eae072 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:36.229221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8c52963a-2a25-41f4-aea4-b344e0eae072 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:36.230708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8c52963a-2a25-41f4-aea4-b344e0eae072 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:36.231870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8c52963a-2a25-41f4-aea4-b344e0eae072 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:36.326166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b5752e75-b5da-4601-8832-dcb8bdca0d3a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:36.334591 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8c52963a-2a25-41f4-aea4-b344e0eae072 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:36.336689 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b5752e75-b5da-4601-8832-dcb8bdca0d3a tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.176557 May 10 16:48:36.338148 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 36/64] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:36 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:36.353736 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8c52963a-2a25-41f4-aea4-b344e0eae072 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:36.355185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8c52963a-2a25-41f4-aea4-b344e0eae072 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:36.356200 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8c52963a-2a25-41f4-aea4-b344e0eae072 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1339 microversion: 2.20 time: 0.149561 May 10 16:48:36.364231 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 29/65] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:36 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1339 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:36.986397 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-59adb655-60ad-4c16-b465-2043d712c118 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:36.986962 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-59adb655-60ad-4c16-b465-2043d712c118 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:36.993590 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-59adb655-60ad-4c16-b465-2043d712c118 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:36.994114 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-59adb655-60ad-4c16-b465-2043d712c118 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:36.994941 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-59adb655-60ad-4c16-b465-2043d712c118 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:36.995476 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-59adb655-60ad-4c16-b465-2043d712c118 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:37.035172 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9c0f754b-fc06-431e-95a9-423a8e816294 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:37.035757 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9c0f754b-fc06-431e-95a9-423a8e816294 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:37.042144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9c0f754b-fc06-431e-95a9-423a8e816294 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:37.042605 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9c0f754b-fc06-431e-95a9-423a8e816294 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:37.043490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9c0f754b-fc06-431e-95a9-423a8e816294 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:37.043936 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9c0f754b-fc06-431e-95a9-423a8e816294 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:37.114022 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9c0f754b-fc06-431e-95a9-423a8e816294 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:37.123292 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9c0f754b-fc06-431e-95a9-423a8e816294 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1295 microversion: 2.1 time: 0.091807 May 10 16:48:37.123979 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 30/66] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:37 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:37.150120 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-59adb655-60ad-4c16-b465-2043d712c118 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:37.158090 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-59adb655-60ad-4c16-b465-2043d712c118 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.175871 May 10 16:48:37.158801 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 37/67] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:36 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:37.354355 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b3b69f3c-b492-4909-a9a4-765d946112af tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:37.354976 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b3b69f3c-b492-4909-a9a4-765d946112af tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:37.361055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3b69f3c-b492-4909-a9a4-765d946112af tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:37.361532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3b69f3c-b492-4909-a9a4-765d946112af tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:37.362332 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3b69f3c-b492-4909-a9a4-765d946112af tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:37.362771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3b69f3c-b492-4909-a9a4-765d946112af tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:37.382912 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-bd28a408-6d0a-4051-b1ba-4719822e7bcd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:37.383607 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-bd28a408-6d0a-4051-b1ba-4719822e7bcd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:37.391339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd28a408-6d0a-4051-b1ba-4719822e7bcd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:37.392031 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd28a408-6d0a-4051-b1ba-4719822e7bcd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:37.393250 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd28a408-6d0a-4051-b1ba-4719822e7bcd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:37.393895 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd28a408-6d0a-4051-b1ba-4719822e7bcd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:37.469117 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bd28a408-6d0a-4051-b1ba-4719822e7bcd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:37.477727 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bd28a408-6d0a-4051-b1ba-4719822e7bcd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:37.479238 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bd28a408-6d0a-4051-b1ba-4719822e7bcd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:37.480372 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-bd28a408-6d0a-4051-b1ba-4719822e7bcd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1339 microversion: 2.20 time: 0.101331 May 10 16:48:37.481024 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 38/68] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:37 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:37.536571 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b3b69f3c-b492-4909-a9a4-765d946112af tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:37.544986 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b3b69f3c-b492-4909-a9a4-765d946112af tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.195340 May 10 16:48:37.545578 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 31/69] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:37 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:38.140750 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d70511fa-c2dd-47b2-a459-ef0e9c76d808 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:38.142346 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d70511fa-c2dd-47b2-a459-ef0e9c76d808 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:38.158922 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d70511fa-c2dd-47b2-a459-ef0e9c76d808 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:38.159713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d70511fa-c2dd-47b2-a459-ef0e9c76d808 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:38.165970 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d70511fa-c2dd-47b2-a459-ef0e9c76d808 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:38.166780 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d70511fa-c2dd-47b2-a459-ef0e9c76d808 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:38.181377 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-736b33dc-f411-47a8-a797-af84bee1b216 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:38.183718 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-736b33dc-f411-47a8-a797-af84bee1b216 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:38.197106 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-736b33dc-f411-47a8-a797-af84bee1b216 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:38.198782 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-736b33dc-f411-47a8-a797-af84bee1b216 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:38.201089 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-736b33dc-f411-47a8-a797-af84bee1b216 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:38.202820 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-736b33dc-f411-47a8-a797-af84bee1b216 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:38.541345 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d70511fa-c2dd-47b2-a459-ef0e9c76d808 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:38.553207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d70511fa-c2dd-47b2-a459-ef0e9c76d808 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1295 microversion: 2.1 time: 0.416616 May 10 16:48:38.557506 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 39/70] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:38 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1295 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:38.562707 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-aa85cba6-297a-490b-8a39-03188d60e26b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:38.567082 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-aa85cba6-297a-490b-8a39-03188d60e26b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:38.590020 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa85cba6-297a-490b-8a39-03188d60e26b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:38.590847 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa85cba6-297a-490b-8a39-03188d60e26b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:38.591962 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa85cba6-297a-490b-8a39-03188d60e26b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:38.592585 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa85cba6-297a-490b-8a39-03188d60e26b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:38.822784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-736b33dc-f411-47a8-a797-af84bee1b216 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:38.836648 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-736b33dc-f411-47a8-a797-af84bee1b216 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.662557 May 10 16:48:38.838793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 32/71] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:38 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:38.856628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-271ceec9-ccdb-4f1e-8c4d-0ed9a3ef7ea8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:38.857401 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-271ceec9-ccdb-4f1e-8c4d-0ed9a3ef7ea8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:38.881358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-271ceec9-ccdb-4f1e-8c4d-0ed9a3ef7ea8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:38.882104 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-271ceec9-ccdb-4f1e-8c4d-0ed9a3ef7ea8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:38.883699 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-271ceec9-ccdb-4f1e-8c4d-0ed9a3ef7ea8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:38.884773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-271ceec9-ccdb-4f1e-8c4d-0ed9a3ef7ea8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:38.938944 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-aa85cba6-297a-490b-8a39-03188d60e26b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:38.964241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-aa85cba6-297a-490b-8a39-03188d60e26b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:38.966057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-aa85cba6-297a-490b-8a39-03188d60e26b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:38.967531 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-aa85cba6-297a-490b-8a39-03188d60e26b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1339 microversion: 2.20 time: 0.408689 May 10 16:48:38.973889 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 40/72] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:38 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1339 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:39.341109 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-271ceec9-ccdb-4f1e-8c4d-0ed9a3ef7ea8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:39.355955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-271ceec9-ccdb-4f1e-8c4d-0ed9a3ef7ea8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.515469 May 10 16:48:39.358489 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 33/73] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:38 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:39.574294 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-613ce97f-5b2c-44bd-a00c-150509d8691e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:39.575071 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-613ce97f-5b2c-44bd-a00c-150509d8691e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:39.592425 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-613ce97f-5b2c-44bd-a00c-150509d8691e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:39.593201 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-613ce97f-5b2c-44bd-a00c-150509d8691e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:39.594268 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-613ce97f-5b2c-44bd-a00c-150509d8691e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:39.594859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-613ce97f-5b2c-44bd-a00c-150509d8691e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:39.752813 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-613ce97f-5b2c-44bd-a00c-150509d8691e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:39.770133 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-613ce97f-5b2c-44bd-a00c-150509d8691e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1295 microversion: 2.1 time: 0.200285 May 10 16:48:39.773511 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 41/74] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:39 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1295 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:39.857523 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a996276c-b7e8-43a9-b8f2-5fc767bb71af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:39.859176 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a996276c-b7e8-43a9-b8f2-5fc767bb71af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:39.874891 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a996276c-b7e8-43a9-b8f2-5fc767bb71af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:39.876716 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a996276c-b7e8-43a9-b8f2-5fc767bb71af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:39.877933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a996276c-b7e8-43a9-b8f2-5fc767bb71af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:39.879227 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a996276c-b7e8-43a9-b8f2-5fc767bb71af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:39.997255 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-69635684-aed6-4341-a776-64d9a81a7296 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:39.998242 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-69635684-aed6-4341-a776-64d9a81a7296 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:40.011165 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-69635684-aed6-4341-a776-64d9a81a7296 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:40.012130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-69635684-aed6-4341-a776-64d9a81a7296 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:40.013602 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-69635684-aed6-4341-a776-64d9a81a7296 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:40.015442 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-69635684-aed6-4341-a776-64d9a81a7296 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:40.237237 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a996276c-b7e8-43a9-b8f2-5fc767bb71af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:40.253681 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a996276c-b7e8-43a9-b8f2-5fc767bb71af tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.395529 May 10 16:48:40.254883 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 34/75] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:39 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:40.375967 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b1249cfb-d4cd-4054-8dc5-4a92135771b8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:40.376797 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b1249cfb-d4cd-4054-8dc5-4a92135771b8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:40.384232 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b1249cfb-d4cd-4054-8dc5-4a92135771b8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:40.384981 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b1249cfb-d4cd-4054-8dc5-4a92135771b8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:40.385906 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b1249cfb-d4cd-4054-8dc5-4a92135771b8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:40.386443 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b1249cfb-d4cd-4054-8dc5-4a92135771b8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:40.531501 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-69635684-aed6-4341-a776-64d9a81a7296 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:40.543477 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-69635684-aed6-4341-a776-64d9a81a7296 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:40.545795 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-69635684-aed6-4341-a776-64d9a81a7296 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:40.549197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-69635684-aed6-4341-a776-64d9a81a7296 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.561644 May 10 16:48:40.550138 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 42/76] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:39 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:40.669749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b1249cfb-d4cd-4054-8dc5-4a92135771b8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:40.681250 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b1249cfb-d4cd-4054-8dc5-4a92135771b8 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.309829 May 10 16:48:40.681847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 35/77] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:40 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:40.790044 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3cb16387-cf20-47b0-8979-071a0f592ac4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:40.790665 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3cb16387-cf20-47b0-8979-071a0f592ac4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:40.807708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3cb16387-cf20-47b0-8979-071a0f592ac4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:40.808165 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3cb16387-cf20-47b0-8979-071a0f592ac4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:40.808995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3cb16387-cf20-47b0-8979-071a0f592ac4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:40.809686 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3cb16387-cf20-47b0-8979-071a0f592ac4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:41.032222 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3cb16387-cf20-47b0-8979-071a0f592ac4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:41.048850 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3cb16387-cf20-47b0-8979-071a0f592ac4 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.263536 May 10 16:48:41.059033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 43/78] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:40 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:41.277876 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-109494e8-edb3-499c-8952-d31621a21e92 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:41.278558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-109494e8-edb3-499c-8952-d31621a21e92 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:41.285209 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-109494e8-edb3-499c-8952-d31621a21e92 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:41.285816 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-109494e8-edb3-499c-8952-d31621a21e92 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:41.286891 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-109494e8-edb3-499c-8952-d31621a21e92 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:41.287410 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-109494e8-edb3-499c-8952-d31621a21e92 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:41.442187 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-109494e8-edb3-499c-8952-d31621a21e92 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:41.450224 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-109494e8-edb3-499c-8952-d31621a21e92 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.178238 May 10 16:48:41.450862 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 36/79] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:41 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:41.568782 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-04e84ef0-35cc-450d-af19-964784ef26db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:41.569865 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-04e84ef0-35cc-450d-af19-964784ef26db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:41.578439 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-04e84ef0-35cc-450d-af19-964784ef26db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:41.578944 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-04e84ef0-35cc-450d-af19-964784ef26db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:41.579749 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-04e84ef0-35cc-450d-af19-964784ef26db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:41.580199 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-04e84ef0-35cc-450d-af19-964784ef26db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:41.701457 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-de47401b-bbe5-4817-ad78-fe31616f67e6 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:41.702509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-de47401b-bbe5-4817-ad78-fe31616f67e6 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:41.711037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-de47401b-bbe5-4817-ad78-fe31616f67e6 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:41.712007 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-de47401b-bbe5-4817-ad78-fe31616f67e6 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:41.713085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-de47401b-bbe5-4817-ad78-fe31616f67e6 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:41.713730 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-de47401b-bbe5-4817-ad78-fe31616f67e6 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:41.740529 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-04e84ef0-35cc-450d-af19-964784ef26db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:41.749081 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-04e84ef0-35cc-450d-af19-964784ef26db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:41.750586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-04e84ef0-35cc-450d-af19-964784ef26db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:41.751721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-04e84ef0-35cc-450d-af19-964784ef26db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.187220 May 10 16:48:41.752300 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 44/80] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:41 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:41.870556 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-de47401b-bbe5-4817-ad78-fe31616f67e6 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:41.879936 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-de47401b-bbe5-4817-ad78-fe31616f67e6 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.182559 May 10 16:48:41.880592 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 37/81] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:41 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:42.066508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-94af1ef0-ceea-430b-b301-e6e0a1211fc6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:42.067013 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-94af1ef0-ceea-430b-b301-e6e0a1211fc6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:42.073567 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-94af1ef0-ceea-430b-b301-e6e0a1211fc6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:42.073982 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-94af1ef0-ceea-430b-b301-e6e0a1211fc6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:42.074825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-94af1ef0-ceea-430b-b301-e6e0a1211fc6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:42.075182 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-94af1ef0-ceea-430b-b301-e6e0a1211fc6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:42.213119 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-94af1ef0-ceea-430b-b301-e6e0a1211fc6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:42.220926 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-94af1ef0-ceea-430b-b301-e6e0a1211fc6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.158340 May 10 16:48:42.222235 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 45/82] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:42 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:42.468599 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d8843d67-1fa2-443b-8282-ca8c9268ba18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:42.469405 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d8843d67-1fa2-443b-8282-ca8c9268ba18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:42.488905 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d8843d67-1fa2-443b-8282-ca8c9268ba18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:42.490608 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d8843d67-1fa2-443b-8282-ca8c9268ba18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:42.493766 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d8843d67-1fa2-443b-8282-ca8c9268ba18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:42.494303 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d8843d67-1fa2-443b-8282-ca8c9268ba18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:42.782074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d8cfb073-7b57-4842-99a8-d5b1c467148a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:42.782250 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d8cfb073-7b57-4842-99a8-d5b1c467148a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:42.811780 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d8cfb073-7b57-4842-99a8-d5b1c467148a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:42.813259 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d8cfb073-7b57-4842-99a8-d5b1c467148a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:42.816416 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d8cfb073-7b57-4842-99a8-d5b1c467148a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:42.816895 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d8cfb073-7b57-4842-99a8-d5b1c467148a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:42.951682 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d8843d67-1fa2-443b-8282-ca8c9268ba18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:42.965761 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d8843d67-1fa2-443b-8282-ca8c9268ba18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.501357 May 10 16:48:42.967551 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 38/83] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:42 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:42.979916 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e627fbb4-e1b7-4b2a-97a4-2a026abe52ff tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:42.982706 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e627fbb4-e1b7-4b2a-97a4-2a026abe52ff tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:43.009105 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e627fbb4-e1b7-4b2a-97a4-2a026abe52ff tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.010074 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e627fbb4-e1b7-4b2a-97a4-2a026abe52ff tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:43.013426 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e627fbb4-e1b7-4b2a-97a4-2a026abe52ff tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.015587 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e627fbb4-e1b7-4b2a-97a4-2a026abe52ff tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:43.224226 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d8cfb073-7b57-4842-99a8-d5b1c467148a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:43.244111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d8cfb073-7b57-4842-99a8-d5b1c467148a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:43.247161 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d8cfb073-7b57-4842-99a8-d5b1c467148a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:43.249657 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d8cfb073-7b57-4842-99a8-d5b1c467148a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.481588 May 10 16:48:43.250911 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 46/84] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:42 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:43.273322 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e627fbb4-e1b7-4b2a-97a4-2a026abe52ff tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:43.284078 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e627fbb4-e1b7-4b2a-97a4-2a026abe52ff tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.313753 May 10 16:48:43.284902 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 39/85] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:42 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:43.313369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-59847841-3dfd-44e5-aa5d-b573de9eae30 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:43.314001 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-59847841-3dfd-44e5-aa5d-b573de9eae30 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:43.321461 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-59847841-3dfd-44e5-aa5d-b573de9eae30 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.322107 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-59847841-3dfd-44e5-aa5d-b573de9eae30 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:43.323120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-59847841-3dfd-44e5-aa5d-b573de9eae30 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.323555 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-59847841-3dfd-44e5-aa5d-b573de9eae30 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:43.398232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-dbb035a6-e1a2-4e9f-a02e-c0341e22276e req-169f435a-1f4b-4338-8d61-9ec3917c677d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0c17d0-fd7d-4f22-a89c-bc390a1cc535", "name": "network-vif-plugged", "status": "completed", "tag": "49626576-c69c-48d0-8b3d-be4360ede3a8"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:43.419442 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-dbb035a6-e1a2-4e9f-a02e-c0341e22276e req-169f435a-1f4b-4338-8d61-9ec3917c677d service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.424227 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-dbb035a6-e1a2-4e9f-a02e-c0341e22276e req-169f435a-1f4b-4338-8d61-9ec3917c677d service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:43.445721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-dbb035a6-e1a2-4e9f-a02e-c0341e22276e req-169f435a-1f4b-4338-8d61-9ec3917c677d service nova] Creating event network-vif-plugged:49626576-c69c-48d0-8b3d-be4360ede3a8 for instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 on hv-cinder-83588 May 10 16:48:43.467409 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-dbb035a6-e1a2-4e9f-a02e-c0341e22276e req-169f435a-1f4b-4338-8d61-9ec3917c677d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214330 May 10 16:48:43.474762 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 47/86] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:43.637239 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-59847841-3dfd-44e5-aa5d-b573de9eae30 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:43.645578 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-117ed893-5e9a-49e5-85c0-52dbf4083cf0 req-5f3b80d4-e58f-421e-a9cc-5e0c4ee86273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b9076f-b216-4383-b9fd-80b05ada72a8", "tag": "0ead7ac5-4337-4cb0-99ac-13f8b389ddd0"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:43.653765 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-59847841-3dfd-44e5-aa5d-b573de9eae30 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.357994 May 10 16:48:43.665168 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 40/87] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:43 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:43.681442 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-117ed893-5e9a-49e5-85c0-52dbf4083cf0 req-5f3b80d4-e58f-421e-a9cc-5e0c4ee86273 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.691326 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-117ed893-5e9a-49e5-85c0-52dbf4083cf0 req-5f3b80d4-e58f-421e-a9cc-5e0c4ee86273 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:43.721045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-117ed893-5e9a-49e5-85c0-52dbf4083cf0 req-5f3b80d4-e58f-421e-a9cc-5e0c4ee86273 service nova] Creating event network-changed:0ead7ac5-4337-4cb0-99ac-13f8b389ddd0 for instance a2b9076f-b216-4383-b9fd-80b05ada72a8 on hv-cinder-83588 May 10 16:48:43.743203 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-117ed893-5e9a-49e5-85c0-52dbf4083cf0 req-5f3b80d4-e58f-421e-a9cc-5e0c4ee86273 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103138 May 10 16:48:43.744140 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 48/88] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:43.776141 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-27a5c8cf-a13e-46f8-a840-a50d0787b8df req-174388ac-3515-437a-a417-ff114ff5c169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6739110-4e68-4993-83ec-7c1503f7b87b", "tag": "494f67f0-21ef-40e7-8bd0-9ab88f71dbef"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:43.790358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-27a5c8cf-a13e-46f8-a840-a50d0787b8df req-174388ac-3515-437a-a417-ff114ff5c169 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.790358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-27a5c8cf-a13e-46f8-a840-a50d0787b8df req-174388ac-3515-437a-a417-ff114ff5c169 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:43.805808 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-27a5c8cf-a13e-46f8-a840-a50d0787b8df req-174388ac-3515-437a-a417-ff114ff5c169 service nova] Creating event network-changed:494f67f0-21ef-40e7-8bd0-9ab88f71dbef for instance c6739110-4e68-4993-83ec-7c1503f7b87b on hv-cinder-83588 May 10 16:48:43.813887 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-27a5c8cf-a13e-46f8-a840-a50d0787b8df req-174388ac-3515-437a-a417-ff114ff5c169 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042306 May 10 16:48:43.815355 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 41/89] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:43.984828 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c5a0d0eb-8363-41a0-b777-44adf0d5cbb1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:43.985894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c5a0d0eb-8363-41a0-b777-44adf0d5cbb1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:43.993335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5a0d0eb-8363-41a0-b777-44adf0d5cbb1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.993935 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5a0d0eb-8363-41a0-b777-44adf0d5cbb1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:43.994984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5a0d0eb-8363-41a0-b777-44adf0d5cbb1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.995431 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5a0d0eb-8363-41a0-b777-44adf0d5cbb1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:44.148364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c5a0d0eb-8363-41a0-b777-44adf0d5cbb1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:44.156432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c5a0d0eb-8363-41a0-b777-44adf0d5cbb1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.175788 May 10 16:48:44.157026 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 49/90] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:43 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:44.269447 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ddf50696-7c55-46be-8fa4-ed51a25678aa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:44.270054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ddf50696-7c55-46be-8fa4-ed51a25678aa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:44.278898 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ddf50696-7c55-46be-8fa4-ed51a25678aa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:44.279358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ddf50696-7c55-46be-8fa4-ed51a25678aa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:44.280140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ddf50696-7c55-46be-8fa4-ed51a25678aa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:44.280620 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ddf50696-7c55-46be-8fa4-ed51a25678aa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:44.308750 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8d12e47c-40e8-453d-9c34-d018f9a594eb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:44.309976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8d12e47c-40e8-453d-9c34-d018f9a594eb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:44.317578 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8d12e47c-40e8-453d-9c34-d018f9a594eb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:44.318345 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8d12e47c-40e8-453d-9c34-d018f9a594eb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:44.319847 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8d12e47c-40e8-453d-9c34-d018f9a594eb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:44.320934 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8d12e47c-40e8-453d-9c34-d018f9a594eb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:44.460969 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ddf50696-7c55-46be-8fa4-ed51a25678aa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:44.469161 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ddf50696-7c55-46be-8fa4-ed51a25678aa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:44.470658 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ddf50696-7c55-46be-8fa4-ed51a25678aa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:44.471773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ddf50696-7c55-46be-8fa4-ed51a25678aa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.206684 May 10 16:48:44.473235 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 42/91] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:44 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:44.493216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8d12e47c-40e8-453d-9c34-d018f9a594eb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:44.500761 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8d12e47c-40e8-453d-9c34-d018f9a594eb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.200849 May 10 16:48:44.501338 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 50/92] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:44 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:44.671354 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a537c718-d074-4965-a734-986692f18ad7 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:44.671962 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a537c718-d074-4965-a734-986692f18ad7 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:44.678281 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a537c718-d074-4965-a734-986692f18ad7 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:44.679412 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a537c718-d074-4965-a734-986692f18ad7 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:44.680178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a537c718-d074-4965-a734-986692f18ad7 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:44.680648 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a537c718-d074-4965-a734-986692f18ad7 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:44.813296 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a537c718-d074-4965-a734-986692f18ad7 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:44.821272 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a537c718-d074-4965-a734-986692f18ad7 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.153686 May 10 16:48:44.822107 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 43/93] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:44 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:45.173000 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0872164f-4e35-4a7a-815e-d558d030addd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:45.173610 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0872164f-4e35-4a7a-815e-d558d030addd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:45.179982 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0872164f-4e35-4a7a-815e-d558d030addd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.180470 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0872164f-4e35-4a7a-815e-d558d030addd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.181244 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0872164f-4e35-4a7a-815e-d558d030addd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.181684 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0872164f-4e35-4a7a-815e-d558d030addd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.326211 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-0872164f-4e35-4a7a-815e-d558d030addd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:45.333889 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0872164f-4e35-4a7a-815e-d558d030addd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.164656 May 10 16:48:45.334472 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 51/94] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:45 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:45.489877 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-601bd60e-2ca9-4a57-8544-30a7278ef18d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:45.490490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-601bd60e-2ca9-4a57-8544-30a7278ef18d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:45.497413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-601bd60e-2ca9-4a57-8544-30a7278ef18d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.497867 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-601bd60e-2ca9-4a57-8544-30a7278ef18d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.498727 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-601bd60e-2ca9-4a57-8544-30a7278ef18d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.499191 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-601bd60e-2ca9-4a57-8544-30a7278ef18d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.518997 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5a5b5b08-9044-4a08-a343-7f2be9cd9446 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:45.519649 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-5a5b5b08-9044-4a08-a343-7f2be9cd9446 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:45.526381 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a5b5b08-9044-4a08-a343-7f2be9cd9446 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.526936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a5b5b08-9044-4a08-a343-7f2be9cd9446 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.527741 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a5b5b08-9044-4a08-a343-7f2be9cd9446 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.528295 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a5b5b08-9044-4a08-a343-7f2be9cd9446 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.654188 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-601bd60e-2ca9-4a57-8544-30a7278ef18d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:45.664384 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-601bd60e-2ca9-4a57-8544-30a7278ef18d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:45.666013 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-601bd60e-2ca9-4a57-8544-30a7278ef18d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:45.667135 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-601bd60e-2ca9-4a57-8544-30a7278ef18d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.181359 May 10 16:48:45.667697 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 44/95] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:45 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:45.738749 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5a5b5b08-9044-4a08-a343-7f2be9cd9446 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:45.759233 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5a5b5b08-9044-4a08-a343-7f2be9cd9446 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.232574 May 10 16:48:45.759233 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 52/96] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:45 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:45.843565 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2eec27b6-e728-489d-baa4-7a9c226799e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:45.845000 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2eec27b6-e728-489d-baa4-7a9c226799e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:45.853101 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2eec27b6-e728-489d-baa4-7a9c226799e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.853680 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2eec27b6-e728-489d-baa4-7a9c226799e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.854659 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2eec27b6-e728-489d-baa4-7a9c226799e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.855185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2eec27b6-e728-489d-baa4-7a9c226799e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:46.316008 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2eec27b6-e728-489d-baa4-7a9c226799e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:46.345794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2eec27b6-e728-489d-baa4-7a9c226799e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.510373 May 10 16:48:46.348013 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 45/97] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:45 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:46.364411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8ee5a37e-ec0c-4d51-9a06-c54b26d23b16 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:46.365700 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8ee5a37e-ec0c-4d51-9a06-c54b26d23b16 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:46.391922 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8ee5a37e-ec0c-4d51-9a06-c54b26d23b16 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:46.392975 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8ee5a37e-ec0c-4d51-9a06-c54b26d23b16 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:46.394328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8ee5a37e-ec0c-4d51-9a06-c54b26d23b16 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:46.395017 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8ee5a37e-ec0c-4d51-9a06-c54b26d23b16 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:46.631045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8ee5a37e-ec0c-4d51-9a06-c54b26d23b16 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:46.639473 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8ee5a37e-ec0c-4d51-9a06-c54b26d23b16 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.291655 May 10 16:48:46.640051 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 53/98] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:46 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:46.694079 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-eac423f8-82ae-45e5-afb4-d73c714d370d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:46.695081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-eac423f8-82ae-45e5-afb4-d73c714d370d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:46.701902 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eac423f8-82ae-45e5-afb4-d73c714d370d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:46.702494 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eac423f8-82ae-45e5-afb4-d73c714d370d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:46.703357 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eac423f8-82ae-45e5-afb4-d73c714d370d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:46.703876 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eac423f8-82ae-45e5-afb4-d73c714d370d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:46.767240 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3af805f4-0c99-4fb2-b64f-26d886c4670b tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:46.767937 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3af805f4-0c99-4fb2-b64f-26d886c4670b tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:46.775689 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3af805f4-0c99-4fb2-b64f-26d886c4670b tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:46.776631 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3af805f4-0c99-4fb2-b64f-26d886c4670b tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:46.778230 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3af805f4-0c99-4fb2-b64f-26d886c4670b tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:46.778941 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3af805f4-0c99-4fb2-b64f-26d886c4670b tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:46.933931 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-eac423f8-82ae-45e5-afb4-d73c714d370d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:46.944901 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-eac423f8-82ae-45e5-afb4-d73c714d370d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:46.945283 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3af805f4-0c99-4fb2-b64f-26d886c4670b tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:46.947509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-eac423f8-82ae-45e5-afb4-d73c714d370d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:46.948777 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-eac423f8-82ae-45e5-afb4-d73c714d370d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.259458 May 10 16:48:46.956919 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3af805f4-0c99-4fb2-b64f-26d886c4670b tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.193449 May 10 16:48:46.958508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 54/99] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:46 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:46.963953 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 46/100] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:46 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:47.369079 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-92c3ba76-bb6c-4104-9c2a-d75274199809 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:47.371215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-92c3ba76-bb6c-4104-9c2a-d75274199809 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:47.383252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-92c3ba76-bb6c-4104-9c2a-d75274199809 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:47.383920 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-92c3ba76-bb6c-4104-9c2a-d75274199809 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:47.385160 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-92c3ba76-bb6c-4104-9c2a-d75274199809 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:47.388312 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-92c3ba76-bb6c-4104-9c2a-d75274199809 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:47.595804 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-92c3ba76-bb6c-4104-9c2a-d75274199809 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:47.604155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-92c3ba76-bb6c-4104-9c2a-d75274199809 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.242112 May 10 16:48:47.605225 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 55/101] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:47 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:47.657569 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4726046d-0654-427b-bc4e-47f0527a39ea tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:47.657819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4726046d-0654-427b-bc4e-47f0527a39ea tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:47.671236 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4726046d-0654-427b-bc4e-47f0527a39ea tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:47.671707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4726046d-0654-427b-bc4e-47f0527a39ea tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:47.675089 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4726046d-0654-427b-bc4e-47f0527a39ea tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:47.675553 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4726046d-0654-427b-bc4e-47f0527a39ea tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:47.979610 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d554ac3c-54b8-4566-b993-51c59b5757fb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:47.980487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d554ac3c-54b8-4566-b993-51c59b5757fb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:47.988105 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d554ac3c-54b8-4566-b993-51c59b5757fb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:47.988706 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d554ac3c-54b8-4566-b993-51c59b5757fb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:47.989767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d554ac3c-54b8-4566-b993-51c59b5757fb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:47.990215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d554ac3c-54b8-4566-b993-51c59b5757fb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:48.193026 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4726046d-0654-427b-bc4e-47f0527a39ea tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:48.212124 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4726046d-0654-427b-bc4e-47f0527a39ea tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.557682 May 10 16:48:48.214880 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 47/102] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:47 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:48.221899 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d7edf8d5-11c7-462e-8cff-66d2d77a63f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:48.223326 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d7edf8d5-11c7-462e-8cff-66d2d77a63f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:48.238075 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7edf8d5-11c7-462e-8cff-66d2d77a63f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:48.239088 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7edf8d5-11c7-462e-8cff-66d2d77a63f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:48.241056 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7edf8d5-11c7-462e-8cff-66d2d77a63f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:48.241986 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7edf8d5-11c7-462e-8cff-66d2d77a63f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:48.547115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d554ac3c-54b8-4566-b993-51c59b5757fb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:48.565647 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d7edf8d5-11c7-462e-8cff-66d2d77a63f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:48.566633 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d554ac3c-54b8-4566-b993-51c59b5757fb tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1315 microversion: 2.1 time: 0.592141 May 10 16:48:48.569024 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 56/103] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:47 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:48.591608 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d7edf8d5-11c7-462e-8cff-66d2d77a63f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:48.594731 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d7edf8d5-11c7-462e-8cff-66d2d77a63f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:48.596036 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d7edf8d5-11c7-462e-8cff-66d2d77a63f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.380131 May 10 16:48:48.596800 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 48/104] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:48 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:48.625128 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8370d08d-ae91-4d94-bd29-29e48673f257 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:48.626461 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8370d08d-ae91-4d94-bd29-29e48673f257 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:48.637353 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8370d08d-ae91-4d94-bd29-29e48673f257 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:48.638251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8370d08d-ae91-4d94-bd29-29e48673f257 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:48.639299 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8370d08d-ae91-4d94-bd29-29e48673f257 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:48.640006 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8370d08d-ae91-4d94-bd29-29e48673f257 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:48.984738 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8370d08d-ae91-4d94-bd29-29e48673f257 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:49.017586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8370d08d-ae91-4d94-bd29-29e48673f257 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.397744 May 10 16:48:49.020884 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 57/105] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:48 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:49.233284 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-64888c0d-f676-4a9c-80d4-daad633f8999 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:49.234286 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-64888c0d-f676-4a9c-80d4-daad633f8999 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:49.252096 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-64888c0d-f676-4a9c-80d4-daad633f8999 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:49.252565 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-64888c0d-f676-4a9c-80d4-daad633f8999 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:49.253365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-64888c0d-f676-4a9c-80d4-daad633f8999 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:49.253801 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-64888c0d-f676-4a9c-80d4-daad633f8999 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:49.500220 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-64888c0d-f676-4a9c-80d4-daad633f8999 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:49.510777 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-64888c0d-f676-4a9c-80d4-daad633f8999 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.284105 May 10 16:48:49.511372 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 49/106] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:49 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:49.590391 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c4df33da-27f1-4027-a4b3-a5b0ddef3f61 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:49.592873 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c4df33da-27f1-4027-a4b3-a5b0ddef3f61 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:49.601497 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c4df33da-27f1-4027-a4b3-a5b0ddef3f61 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:49.602496 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c4df33da-27f1-4027-a4b3-a5b0ddef3f61 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:49.603608 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c4df33da-27f1-4027-a4b3-a5b0ddef3f61 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:49.604054 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c4df33da-27f1-4027-a4b3-a5b0ddef3f61 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:49.615324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ace91a69-f684-4bc3-baf5-83a05ea32844 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:49.616955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ace91a69-f684-4bc3-baf5-83a05ea32844 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:49.628953 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ace91a69-f684-4bc3-baf5-83a05ea32844 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:49.629696 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ace91a69-f684-4bc3-baf5-83a05ea32844 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:49.630249 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ace91a69-f684-4bc3-baf5-83a05ea32844 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:49.630692 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ace91a69-f684-4bc3-baf5-83a05ea32844 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:49.852056 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c4df33da-27f1-4027-a4b3-a5b0ddef3f61 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:49.874247 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c4df33da-27f1-4027-a4b3-a5b0ddef3f61 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1501 microversion: 2.1 time: 0.288157 May 10 16:48:49.879545 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 58/107] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:49 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:50.038597 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-dc9a43d5-6b4d-4825-a7d5-945b4d8276aa tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:50.039574 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-dc9a43d5-6b4d-4825-a7d5-945b4d8276aa tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:50.061765 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc9a43d5-6b4d-4825-a7d5-945b4d8276aa tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:50.063628 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc9a43d5-6b4d-4825-a7d5-945b4d8276aa tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:50.065486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc9a43d5-6b4d-4825-a7d5-945b4d8276aa tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:50.066582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc9a43d5-6b4d-4825-a7d5-945b4d8276aa tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:50.145282 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ace91a69-f684-4bc3-baf5-83a05ea32844 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:50.154863 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ace91a69-f684-4bc3-baf5-83a05ea32844 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:50.156390 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ace91a69-f684-4bc3-baf5-83a05ea32844 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:50.160011 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ace91a69-f684-4bc3-baf5-83a05ea32844 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.547648 May 10 16:48:50.160666 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 50/108] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:49 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:50.337556 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-dc9a43d5-6b4d-4825-a7d5-945b4d8276aa tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:50.347348 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-dc9a43d5-6b4d-4825-a7d5-945b4d8276aa tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.313182 May 10 16:48:50.347899 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 59/109] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:50 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:50.529384 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-26ceddb9-f2f5-490c-9fca-0b4fa7e68915 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:50.531226 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-26ceddb9-f2f5-490c-9fca-0b4fa7e68915 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:50.546334 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-26ceddb9-f2f5-490c-9fca-0b4fa7e68915 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:50.547068 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-26ceddb9-f2f5-490c-9fca-0b4fa7e68915 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:50.548014 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-26ceddb9-f2f5-490c-9fca-0b4fa7e68915 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:50.549313 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-26ceddb9-f2f5-490c-9fca-0b4fa7e68915 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:50.812233 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-26ceddb9-f2f5-490c-9fca-0b4fa7e68915 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:50.820930 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-26ceddb9-f2f5-490c-9fca-0b4fa7e68915 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.296688 May 10 16:48:50.837072 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 51/110] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:50 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:51.182813 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b1ea256e-70cd-4685-873d-15c74281f81c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:51.185370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b1ea256e-70cd-4685-873d-15c74281f81c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:51.199022 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b1ea256e-70cd-4685-873d-15c74281f81c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:51.199669 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b1ea256e-70cd-4685-873d-15c74281f81c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:51.214545 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b1ea256e-70cd-4685-873d-15c74281f81c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:51.215150 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b1ea256e-70cd-4685-873d-15c74281f81c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:51.367949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f79dac49-4c64-42ad-8e29-be6346e8c2ce tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:51.368872 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f79dac49-4c64-42ad-8e29-be6346e8c2ce tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:51.378418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f79dac49-4c64-42ad-8e29-be6346e8c2ce tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:51.380264 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f79dac49-4c64-42ad-8e29-be6346e8c2ce tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:51.381417 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f79dac49-4c64-42ad-8e29-be6346e8c2ce tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:51.382054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f79dac49-4c64-42ad-8e29-be6346e8c2ce tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:51.435439 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b1ea256e-70cd-4685-873d-15c74281f81c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:51.451215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b1ea256e-70cd-4685-873d-15c74281f81c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:51.451215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b1ea256e-70cd-4685-873d-15c74281f81c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:51.451427 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b1ea256e-70cd-4685-873d-15c74281f81c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.276738 May 10 16:48:51.462716 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 60/111] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:51 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:51.515210 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-94fd50b0-1491-4885-b775-e030814de8cf tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fa0cfad-8c50-4043-ac8d-71bf869458a8"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:51.518918 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-94fd50b0-1491-4885-b775-e030814de8cf tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:51.534210 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-94fd50b0-1491-4885-b775-e030814de8cf tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:51.535314 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-94fd50b0-1491-4885-b775-e030814de8cf tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:51.536805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-94fd50b0-1491-4885-b775-e030814de8cf tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:51.538570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-94fd50b0-1491-4885-b775-e030814de8cf tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:51.621666 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f79dac49-4c64-42ad-8e29-be6346e8c2ce tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:51.636701 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f79dac49-4c64-42ad-8e29-be6346e8c2ce tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.273808 May 10 16:48:51.637385 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 52/112] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:51 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:51.844478 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5a994769-9b53-4937-86ba-ac552aa8cad8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:51.847495 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5a994769-9b53-4937-86ba-ac552aa8cad8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:51.869854 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5a994769-9b53-4937-86ba-ac552aa8cad8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:51.871059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5a994769-9b53-4937-86ba-ac552aa8cad8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:51.873014 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5a994769-9b53-4937-86ba-ac552aa8cad8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:51.873725 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5a994769-9b53-4937-86ba-ac552aa8cad8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:52.091579 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-5a994769-9b53-4937-86ba-ac552aa8cad8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:52.105234 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-5a994769-9b53-4937-86ba-ac552aa8cad8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.270749 May 10 16:48:52.107722 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 53/113] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:51 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:52.117446 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-94fd50b0-1491-4885-b775-e030814de8cf tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "POST /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.603425 May 10 16:48:52.117446 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 61/114] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:48:51 2022] POST /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535/os-volume_attachments => generated 194 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:48:52.128673 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-e5991162-9c8b-4f4e-8ff7-5652a180a0a9 req-9f39a202-559c-4400-a4e6-c0bfb83d6599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec359fa-52db-434d-8b29-f0d796faf8c0", "name": "network-vif-plugged", "status": "completed", "tag": "9159b071-bf14-4943-ad14-db670af07144"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:52.145987 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-e5991162-9c8b-4f4e-8ff7-5652a180a0a9 req-9f39a202-559c-4400-a4e6-c0bfb83d6599 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:52.146431 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-e5991162-9c8b-4f4e-8ff7-5652a180a0a9 req-9f39a202-559c-4400-a4e6-c0bfb83d6599 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:52.176507 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-e5991162-9c8b-4f4e-8ff7-5652a180a0a9 req-9f39a202-559c-4400-a4e6-c0bfb83d6599 service nova] Creating event network-vif-plugged:9159b071-bf14-4943-ad14-db670af07144 for instance dec359fa-52db-434d-8b29-f0d796faf8c0 on hv-cinder-83588 May 10 16:48:52.186768 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-e5991162-9c8b-4f4e-8ff7-5652a180a0a9 req-9f39a202-559c-4400-a4e6-c0bfb83d6599 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076494 May 10 16:48:52.187383 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 54/115] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:52.475007 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c9e8201c-23bb-4653-a065-8ec554a78652 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:52.478197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c9e8201c-23bb-4653-a065-8ec554a78652 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:52.497398 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c9e8201c-23bb-4653-a065-8ec554a78652 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:52.497864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c9e8201c-23bb-4653-a065-8ec554a78652 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:52.498831 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c9e8201c-23bb-4653-a065-8ec554a78652 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:52.501647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c9e8201c-23bb-4653-a065-8ec554a78652 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:52.657167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-60f16108-bb6c-440a-8a0b-3958fa7163ec tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:52.659945 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-60f16108-bb6c-440a-8a0b-3958fa7163ec tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:52.679841 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-60f16108-bb6c-440a-8a0b-3958fa7163ec tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:52.680515 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-60f16108-bb6c-440a-8a0b-3958fa7163ec tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:52.683441 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-60f16108-bb6c-440a-8a0b-3958fa7163ec tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:52.684970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-60f16108-bb6c-440a-8a0b-3958fa7163ec tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:52.718549 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c9e8201c-23bb-4653-a065-8ec554a78652 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:52.734307 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c9e8201c-23bb-4653-a065-8ec554a78652 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:52.737712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c9e8201c-23bb-4653-a065-8ec554a78652 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:52.739544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c9e8201c-23bb-4653-a065-8ec554a78652 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.273093 May 10 16:48:52.740882 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 62/116] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:52 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:52.904508 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-60f16108-bb6c-440a-8a0b-3958fa7163ec tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:52.912553 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-60f16108-bb6c-440a-8a0b-3958fa7163ec tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.261631 May 10 16:48:52.913241 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 55/117] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:52 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:53.124573 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d0eefb72-274f-43f4-bbb6-2819160e4d39 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:53.125391 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d0eefb72-274f-43f4-bbb6-2819160e4d39 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:53.132497 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d0eefb72-274f-43f4-bbb6-2819160e4d39 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:53.133396 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d0eefb72-274f-43f4-bbb6-2819160e4d39 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:53.134193 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d0eefb72-274f-43f4-bbb6-2819160e4d39 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:53.134642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d0eefb72-274f-43f4-bbb6-2819160e4d39 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:53.297780 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d0eefb72-274f-43f4-bbb6-2819160e4d39 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:53.309741 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d0eefb72-274f-43f4-bbb6-2819160e4d39 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.188715 May 10 16:48:53.311070 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 63/118] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:53 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:53.759417 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f317b530-9061-4120-855c-47dab25938ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:53.760069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f317b530-9061-4120-855c-47dab25938ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:53.767293 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f317b530-9061-4120-855c-47dab25938ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:53.770271 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f317b530-9061-4120-855c-47dab25938ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:53.771108 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f317b530-9061-4120-855c-47dab25938ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:53.771544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f317b530-9061-4120-855c-47dab25938ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:53.931653 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2099fc16-bedc-4c64-be77-38ddc50bb47b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:53.932443 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2099fc16-bedc-4c64-be77-38ddc50bb47b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:53.943627 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f317b530-9061-4120-855c-47dab25938ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:53.945824 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2099fc16-bedc-4c64-be77-38ddc50bb47b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:53.946303 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2099fc16-bedc-4c64-be77-38ddc50bb47b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:53.948006 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2099fc16-bedc-4c64-be77-38ddc50bb47b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:53.948491 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2099fc16-bedc-4c64-be77-38ddc50bb47b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:53.957379 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f317b530-9061-4120-855c-47dab25938ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:53.959051 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f317b530-9061-4120-855c-47dab25938ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:53.963851 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f317b530-9061-4120-855c-47dab25938ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.205985 May 10 16:48:53.964518 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 56/119] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:53 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:54.135091 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2099fc16-bedc-4c64-be77-38ddc50bb47b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:54.142954 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2099fc16-bedc-4c64-be77-38ddc50bb47b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.217782 May 10 16:48:54.143865 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 64/120] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:53 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:54.214804 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-ad321caa-6e97-470a-992e-a32d58be6bee req-e47a73e4-cb5c-492f-8f7c-28bb95ca38b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82b30ce-5490-4df6-8d9e-12bf93154ae8", "name": "network-vif-plugged", "status": "completed", "tag": "2e36c520-ea08-4d13-beae-c69470ab57c8"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:54.226012 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-ad321caa-6e97-470a-992e-a32d58be6bee req-e47a73e4-cb5c-492f-8f7c-28bb95ca38b5 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:54.226940 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-ad321caa-6e97-470a-992e-a32d58be6bee req-e47a73e4-cb5c-492f-8f7c-28bb95ca38b5 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:54.251741 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-ad321caa-6e97-470a-992e-a32d58be6bee req-e47a73e4-cb5c-492f-8f7c-28bb95ca38b5 service nova] Creating event network-vif-plugged:2e36c520-ea08-4d13-beae-c69470ab57c8 for instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 on hv-cinder-83588 May 10 16:48:54.260713 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-ad321caa-6e97-470a-992e-a32d58be6bee req-e47a73e4-cb5c-492f-8f7c-28bb95ca38b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052019 May 10 16:48:54.262528 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 57/121] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:54.328013 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5ca55589-4230-4767-87af-5dc572e87af8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:54.328776 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-5ca55589-4230-4767-87af-5dc572e87af8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:54.338831 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5ca55589-4230-4767-87af-5dc572e87af8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:54.339315 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5ca55589-4230-4767-87af-5dc572e87af8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:54.340155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5ca55589-4230-4767-87af-5dc572e87af8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:54.346621 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5ca55589-4230-4767-87af-5dc572e87af8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:54.569587 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5ca55589-4230-4767-87af-5dc572e87af8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:54.578482 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5ca55589-4230-4767-87af-5dc572e87af8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.255285 May 10 16:48:54.584351 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 65/122] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:54 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:54.982680 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b1c8dab2-9667-4a11-979d-de658ce2cd1d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:54.983949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b1c8dab2-9667-4a11-979d-de658ce2cd1d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:54.990347 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b1c8dab2-9667-4a11-979d-de658ce2cd1d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:54.991075 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b1c8dab2-9667-4a11-979d-de658ce2cd1d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:54.992090 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b1c8dab2-9667-4a11-979d-de658ce2cd1d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:54.992773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b1c8dab2-9667-4a11-979d-de658ce2cd1d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:55.158624 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b1c8dab2-9667-4a11-979d-de658ce2cd1d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:55.160611 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-69e578b9-218b-4074-96fa-c11c0156cffb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:55.161756 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-69e578b9-218b-4074-96fa-c11c0156cffb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:55.169338 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-69e578b9-218b-4074-96fa-c11c0156cffb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:55.170007 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-69e578b9-218b-4074-96fa-c11c0156cffb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:55.170508 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b1c8dab2-9667-4a11-979d-de658ce2cd1d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:55.171147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-69e578b9-218b-4074-96fa-c11c0156cffb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:55.171846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-69e578b9-218b-4074-96fa-c11c0156cffb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:55.172830 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b1c8dab2-9667-4a11-979d-de658ce2cd1d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:55.174791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b1c8dab2-9667-4a11-979d-de658ce2cd1d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.196768 May 10 16:48:55.175451 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 58/123] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:54 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:55.339439 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-69e578b9-218b-4074-96fa-c11c0156cffb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:55.347479 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-69e578b9-218b-4074-96fa-c11c0156cffb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.190843 May 10 16:48:55.354978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 66/124] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:55 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:55.599594 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-1ea82c89-7955-42ba-aa7d-2ad190ca40d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:55.600957 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-1ea82c89-7955-42ba-aa7d-2ad190ca40d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:55.612621 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1ea82c89-7955-42ba-aa7d-2ad190ca40d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:55.613547 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1ea82c89-7955-42ba-aa7d-2ad190ca40d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:55.614624 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1ea82c89-7955-42ba-aa7d-2ad190ca40d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:55.615230 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1ea82c89-7955-42ba-aa7d-2ad190ca40d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:55.810592 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-1ea82c89-7955-42ba-aa7d-2ad190ca40d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:55.820144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-1ea82c89-7955-42ba-aa7d-2ad190ca40d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1322 microversion: 2.1 time: 0.227241 May 10 16:48:55.821338 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 59/125] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:55 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:56.199594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-762cb758-7868-4724-9d83-88a729101baf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:56.200934 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-762cb758-7868-4724-9d83-88a729101baf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:56.208042 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-762cb758-7868-4724-9d83-88a729101baf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:56.208552 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-762cb758-7868-4724-9d83-88a729101baf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:56.209914 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-762cb758-7868-4724-9d83-88a729101baf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:56.210343 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-762cb758-7868-4724-9d83-88a729101baf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:56.372052 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9982f4ea-3d10-408c-b5d1-34cea3a2943c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:56.373954 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9982f4ea-3d10-408c-b5d1-34cea3a2943c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:56.380727 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9982f4ea-3d10-408c-b5d1-34cea3a2943c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:56.381563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9982f4ea-3d10-408c-b5d1-34cea3a2943c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:56.382182 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9982f4ea-3d10-408c-b5d1-34cea3a2943c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:56.382783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9982f4ea-3d10-408c-b5d1-34cea3a2943c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:56.492518 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-762cb758-7868-4724-9d83-88a729101baf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:56.504692 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-762cb758-7868-4724-9d83-88a729101baf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:56.508716 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-762cb758-7868-4724-9d83-88a729101baf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:56.509895 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-762cb758-7868-4724-9d83-88a729101baf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.316605 May 10 16:48:56.517668 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 67/126] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:56 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:56.583206 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9982f4ea-3d10-408c-b5d1-34cea3a2943c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:56.592697 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9982f4ea-3d10-408c-b5d1-34cea3a2943c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.224837 May 10 16:48:56.606722 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 60/127] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:56 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:56.847622 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-41bbd694-3340-4453-a939-070e9a24381a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:56.848599 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-41bbd694-3340-4453-a939-070e9a24381a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:56.856499 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-41bbd694-3340-4453-a939-070e9a24381a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:56.857212 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-41bbd694-3340-4453-a939-070e9a24381a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:56.858085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-41bbd694-3340-4453-a939-070e9a24381a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:56.864223 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-41bbd694-3340-4453-a939-070e9a24381a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:57.058772 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-41bbd694-3340-4453-a939-070e9a24381a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:57.066687 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-41bbd694-3340-4453-a939-070e9a24381a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1516 microversion: 2.1 time: 0.224137 May 10 16:48:57.076845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 68/128] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:56 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1516 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:57.086330 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3c2f222f-4286-474a-8888-65507eb3e337 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:57.087372 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3c2f222f-4286-474a-8888-65507eb3e337 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:57.093798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3c2f222f-4286-474a-8888-65507eb3e337 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:57.094246 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3c2f222f-4286-474a-8888-65507eb3e337 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:57.095023 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3c2f222f-4286-474a-8888-65507eb3e337 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:57.095454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3c2f222f-4286-474a-8888-65507eb3e337 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:57.203470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-3c2f222f-4286-474a-8888-65507eb3e337 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lazy-loading 'flavor' on Instance uuid dec359fa-52db-434d-8b29-f0d796faf8c0 {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:48:57.424380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3c2f222f-4286-474a-8888-65507eb3e337 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0/action" status: 200 len: 32 microversion: 2.1 time: 0.342987 May 10 16:48:57.426859 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 61/129] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:48:57 2022] POST /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0/action => generated 32 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:48:57.436795 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2b1de702-b79c-428c-b529-d786c88e76d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:57.437465 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2b1de702-b79c-428c-b529-d786c88e76d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:57.449018 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2b1de702-b79c-428c-b529-d786c88e76d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:57.455129 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2b1de702-b79c-428c-b529-d786c88e76d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:57.456640 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2b1de702-b79c-428c-b529-d786c88e76d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:57.458073 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2b1de702-b79c-428c-b529-d786c88e76d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:57.542225 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c0f8d148-d4fd-4695-9279-fddfec5ea89d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:57.543245 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c0f8d148-d4fd-4695-9279-fddfec5ea89d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:57.552936 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c0f8d148-d4fd-4695-9279-fddfec5ea89d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:57.555069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c0f8d148-d4fd-4695-9279-fddfec5ea89d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:57.556803 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c0f8d148-d4fd-4695-9279-fddfec5ea89d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:57.557519 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c0f8d148-d4fd-4695-9279-fddfec5ea89d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:57.683721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2b1de702-b79c-428c-b529-d786c88e76d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:57.696873 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2b1de702-b79c-428c-b529-d786c88e76d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.263892 May 10 16:48:57.708135 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 69/130] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:57 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:57.715032 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d95f4b63-7e12-45c4-8fc4-c8e606094cdb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:57.715917 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d95f4b63-7e12-45c4-8fc4-c8e606094cdb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:57.724309 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d95f4b63-7e12-45c4-8fc4-c8e606094cdb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:57.726239 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d95f4b63-7e12-45c4-8fc4-c8e606094cdb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:57.727491 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d95f4b63-7e12-45c4-8fc4-c8e606094cdb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:57.728358 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d95f4b63-7e12-45c4-8fc4-c8e606094cdb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:57.782376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c0f8d148-d4fd-4695-9279-fddfec5ea89d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:57.793126 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c0f8d148-d4fd-4695-9279-fddfec5ea89d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:57.794861 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c0f8d148-d4fd-4695-9279-fddfec5ea89d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:57.796093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c0f8d148-d4fd-4695-9279-fddfec5ea89d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.271239 May 10 16:48:57.797126 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 62/131] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:57 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:58.006295 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d95f4b63-7e12-45c4-8fc4-c8e606094cdb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:58.018822 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d95f4b63-7e12-45c4-8fc4-c8e606094cdb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.309021 May 10 16:48:58.030451 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 70/132] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:57 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:58.210074 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-6157e09d-e8d7-44d5-a71f-a77898098345 req-afe503e0-1814-4421-a402-c0813dcba9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b9076f-b216-4383-b9fd-80b05ada72a8", "name": "network-vif-plugged", "status": "completed", "tag": "0ead7ac5-4337-4cb0-99ac-13f8b389ddd0"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:58.219647 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-6157e09d-e8d7-44d5-a71f-a77898098345 req-afe503e0-1814-4421-a402-c0813dcba9f0 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:58.220155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-6157e09d-e8d7-44d5-a71f-a77898098345 req-afe503e0-1814-4421-a402-c0813dcba9f0 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:58.234503 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-6157e09d-e8d7-44d5-a71f-a77898098345 req-afe503e0-1814-4421-a402-c0813dcba9f0 service nova] Creating event network-vif-plugged:0ead7ac5-4337-4cb0-99ac-13f8b389ddd0 for instance a2b9076f-b216-4383-b9fd-80b05ada72a8 on hv-cinder-83588 May 10 16:48:58.239939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-6157e09d-e8d7-44d5-a71f-a77898098345 req-afe503e0-1814-4421-a402-c0813dcba9f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033870 May 10 16:48:58.241695 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 63/133] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:58.716428 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-926bcbc9-6c2a-48db-97ae-0ff678cf145d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:58.717204 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-926bcbc9-6c2a-48db-97ae-0ff678cf145d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:58.726564 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-926bcbc9-6c2a-48db-97ae-0ff678cf145d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:58.729033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-926bcbc9-6c2a-48db-97ae-0ff678cf145d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:58.729938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-926bcbc9-6c2a-48db-97ae-0ff678cf145d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:58.730504 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-926bcbc9-6c2a-48db-97ae-0ff678cf145d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:58.818492 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-741e3744-9937-4efd-a105-62152d4a2493 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:58.820051 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-741e3744-9937-4efd-a105-62152d4a2493 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:58.835872 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-741e3744-9937-4efd-a105-62152d4a2493 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:58.837267 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-741e3744-9937-4efd-a105-62152d4a2493 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:58.838570 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-741e3744-9937-4efd-a105-62152d4a2493 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:58.839480 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-741e3744-9937-4efd-a105-62152d4a2493 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:59.060722 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-926bcbc9-6c2a-48db-97ae-0ff678cf145d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:59.075587 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-926bcbc9-6c2a-48db-97ae-0ff678cf145d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.363906 May 10 16:48:59.077821 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 71/134] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:58 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:59.082760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-34f20796-bb63-4899-af5a-c64809f71c16 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:59.083656 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-34f20796-bb63-4899-af5a-c64809f71c16 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:59.097644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34f20796-bb63-4899-af5a-c64809f71c16 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:59.098351 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34f20796-bb63-4899-af5a-c64809f71c16 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:59.099694 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34f20796-bb63-4899-af5a-c64809f71c16 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:59.101633 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34f20796-bb63-4899-af5a-c64809f71c16 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:59.149357 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-741e3744-9937-4efd-a105-62152d4a2493 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:59.160203 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-741e3744-9937-4efd-a105-62152d4a2493 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:59.161980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-741e3744-9937-4efd-a105-62152d4a2493 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:59.164695 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-741e3744-9937-4efd-a105-62152d4a2493 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.351027 May 10 16:48:59.165406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 64/135] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:48:58 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:59.433492 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-34f20796-bb63-4899-af5a-c64809f71c16 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:59.454891 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-34f20796-bb63-4899-af5a-c64809f71c16 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.375807 May 10 16:48:59.455490 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 72/136] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:48:59 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:00.093931 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e5f61b02-6fc3-4a9d-a456-09cbce8c54d4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:00.095231 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e5f61b02-6fc3-4a9d-a456-09cbce8c54d4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:00.119411 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5f61b02-6fc3-4a9d-a456-09cbce8c54d4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:00.120525 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5f61b02-6fc3-4a9d-a456-09cbce8c54d4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:00.121802 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5f61b02-6fc3-4a9d-a456-09cbce8c54d4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:00.122631 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5f61b02-6fc3-4a9d-a456-09cbce8c54d4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:00.184479 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-97b08e59-43d9-4cec-8f19-10a644ebb324 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:00.185096 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-97b08e59-43d9-4cec-8f19-10a644ebb324 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:00.197104 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97b08e59-43d9-4cec-8f19-10a644ebb324 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:00.199601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97b08e59-43d9-4cec-8f19-10a644ebb324 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:00.211900 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97b08e59-43d9-4cec-8f19-10a644ebb324 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:00.212640 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97b08e59-43d9-4cec-8f19-10a644ebb324 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:00.398950 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e5f61b02-6fc3-4a9d-a456-09cbce8c54d4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:00.414630 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e5f61b02-6fc3-4a9d-a456-09cbce8c54d4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.323406 May 10 16:49:00.416002 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 65/137] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:00 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:00.432182 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-9116066e-2da1-484f-b07b-4bc02ff62523 req-3c298751-c6e9-4aff-9cf3-7411c0729ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6739110-4e68-4993-83ec-7c1503f7b87b", "name": "network-vif-plugged", "status": "completed", "tag": "494f67f0-21ef-40e7-8bd0-9ab88f71dbef"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:00.451089 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-9116066e-2da1-484f-b07b-4bc02ff62523 req-3c298751-c6e9-4aff-9cf3-7411c0729ca4 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:00.451724 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-9116066e-2da1-484f-b07b-4bc02ff62523 req-3c298751-c6e9-4aff-9cf3-7411c0729ca4 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:00.466386 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-9116066e-2da1-484f-b07b-4bc02ff62523 req-3c298751-c6e9-4aff-9cf3-7411c0729ca4 service nova] Creating event network-vif-plugged:494f67f0-21ef-40e7-8bd0-9ab88f71dbef for instance c6739110-4e68-4993-83ec-7c1503f7b87b on hv-cinder-83588 May 10 16:49:00.473096 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-9116066e-2da1-484f-b07b-4bc02ff62523 req-3c298751-c6e9-4aff-9cf3-7411c0729ca4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055679 May 10 16:49:00.474217 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 66/138] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:00.482886 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-66f98d7a-5586-40f6-b341-777f986d5ffd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:00.484398 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-66f98d7a-5586-40f6-b341-777f986d5ffd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:00.495771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-66f98d7a-5586-40f6-b341-777f986d5ffd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:00.496221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-66f98d7a-5586-40f6-b341-777f986d5ffd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:00.497633 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-66f98d7a-5586-40f6-b341-777f986d5ffd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:00.498567 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-66f98d7a-5586-40f6-b341-777f986d5ffd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:00.758886 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-97b08e59-43d9-4cec-8f19-10a644ebb324 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:00.782645 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-66f98d7a-5586-40f6-b341-777f986d5ffd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:00.792066 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-66f98d7a-5586-40f6-b341-777f986d5ffd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1362 microversion: 2.1 time: 0.314842 May 10 16:49:00.797220 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-97b08e59-43d9-4cec-8f19-10a644ebb324 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:00.807496 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 67/139] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:00 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:00.829071 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-97b08e59-43d9-4cec-8f19-10a644ebb324 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:00.829071 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-97b08e59-43d9-4cec-8f19-10a644ebb324 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.629468 May 10 16:49:00.832451 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 73/140] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:49:00 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:01.434873 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cee656c2-d0f3-4bc8-bdc5-2422f5664454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:01.435503 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cee656c2-d0f3-4bc8-bdc5-2422f5664454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:01.464694 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cee656c2-d0f3-4bc8-bdc5-2422f5664454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:01.465164 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cee656c2-d0f3-4bc8-bdc5-2422f5664454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:01.465963 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cee656c2-d0f3-4bc8-bdc5-2422f5664454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:01.466401 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cee656c2-d0f3-4bc8-bdc5-2422f5664454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:01.686231 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cee656c2-d0f3-4bc8-bdc5-2422f5664454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:01.700135 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cee656c2-d0f3-4bc8-bdc5-2422f5664454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.267904 May 10 16:49:01.702283 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 68/141] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:01 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:01.839082 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c5b1a004-0428-47c8-9e53-6abd74167b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:01.839953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c5b1a004-0428-47c8-9e53-6abd74167b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:01.841305 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-24ac49b2-e7bf-4b4b-9c81-478511f4db01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:01.841999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-24ac49b2-e7bf-4b4b-9c81-478511f4db01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:01.852422 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5b1a004-0428-47c8-9e53-6abd74167b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:01.853228 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5b1a004-0428-47c8-9e53-6abd74167b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:01.854442 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5b1a004-0428-47c8-9e53-6abd74167b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:01.855577 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5b1a004-0428-47c8-9e53-6abd74167b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:01.856773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-24ac49b2-e7bf-4b4b-9c81-478511f4db01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:01.857237 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-24ac49b2-e7bf-4b4b-9c81-478511f4db01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:01.859921 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-24ac49b2-e7bf-4b4b-9c81-478511f4db01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:01.860226 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-24ac49b2-e7bf-4b4b-9c81-478511f4db01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:02.028185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c5b1a004-0428-47c8-9e53-6abd74167b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:02.036044 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-24ac49b2-e7bf-4b4b-9c81-478511f4db01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:02.042660 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c5b1a004-0428-47c8-9e53-6abd74167b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:02.044168 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c5b1a004-0428-47c8-9e53-6abd74167b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:02.045311 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c5b1a004-0428-47c8-9e53-6abd74167b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.210478 May 10 16:49:02.047006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-24ac49b2-e7bf-4b4b-9c81-478511f4db01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1548 microversion: 2.1 time: 0.211054 May 10 16:49:02.047753 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 69/142] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:01 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1548 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:02.060434 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 74/143] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:49:01 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:02.067451 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-bff26b5f-94c2-4a2a-b920-4db55fbeb386 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:02.067932 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-bff26b5f-94c2-4a2a-b920-4db55fbeb386 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:02.074224 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bff26b5f-94c2-4a2a-b920-4db55fbeb386 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:02.074860 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bff26b5f-94c2-4a2a-b920-4db55fbeb386 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:02.075824 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bff26b5f-94c2-4a2a-b920-4db55fbeb386 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:02.076437 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bff26b5f-94c2-4a2a-b920-4db55fbeb386 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:02.173821 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-bff26b5f-94c2-4a2a-b920-4db55fbeb386 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109773 May 10 16:49:02.174741 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 75/144] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 10 16:49:02 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:02.720958 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e3ded170-3754-488b-98d4-4fc64e713e44 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:02.722716 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e3ded170-3754-488b-98d4-4fc64e713e44 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:02.729882 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e3ded170-3754-488b-98d4-4fc64e713e44 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:02.730362 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e3ded170-3754-488b-98d4-4fc64e713e44 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:02.731316 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e3ded170-3754-488b-98d4-4fc64e713e44 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:02.731905 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e3ded170-3754-488b-98d4-4fc64e713e44 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:02.931427 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-710311065", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "networks": [{"uuid": "29cfe5c6-1718-45f0-8637-a49017b78c15"}]}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:02.935698 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e3ded170-3754-488b-98d4-4fc64e713e44 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:02.946248 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e3ded170-3754-488b-98d4-4fc64e713e44 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.230540 May 10 16:49:02.958293 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 70/145] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:02 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:03.012711 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.network.neutron [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] validate_networks() for [('29cfe5c6-1718-45f0-8637-a49017b78c15', None, None, None, None, None)] {{(pid=134195) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:49:03.068915 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-79144476-c81c-4c44-995a-99a7af97a476 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:03.070278 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-79144476-c81c-4c44-995a-99a7af97a476 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:03.078352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79144476-c81c-4c44-995a-99a7af97a476 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:03.079006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79144476-c81c-4c44-995a-99a7af97a476 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:03.079931 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79144476-c81c-4c44-995a-99a7af97a476 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:03.080575 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79144476-c81c-4c44-995a-99a7af97a476 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:03.240764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-79144476-c81c-4c44-995a-99a7af97a476 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:03.250759 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-79144476-c81c-4c44-995a-99a7af97a476 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:03.252320 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-79144476-c81c-4c44-995a-99a7af97a476 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:03.253461 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-79144476-c81c-4c44-995a-99a7af97a476 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.191066 May 10 16:49:03.255087 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 71/146] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:49:03 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:03.902688 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Flavor limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:49:03.903116 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Image limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:49:03.903654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Flavor pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:49:03.904068 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Image pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:49:03.904523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:49:03.915014 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:03.915467 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:03.916358 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:03.916795 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:03.941888 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Getting quotas for project d968e17fa36f403a923b7b42af28333d. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:49:03.952419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Getting quotas for user 0cc5e5dfa3bb45c6bf8c4fcfcaadceec and project d968e17fa36f403a923b7b42af28333d. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:49:03.966233 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7b73ea4b-0c43-41c3-ad19-b96499c3b471 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:03.967536 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7b73ea4b-0c43-41c3-ad19-b96499c3b471 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:03.969181 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Going to run 1 instances... {{(pid=134195) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:49:03.972176 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134195) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:49:03.978175 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7b73ea4b-0c43-41c3-ad19-b96499c3b471 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:03.979663 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7b73ea4b-0c43-41c3-ad19-b96499c3b471 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:03.980989 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7b73ea4b-0c43-41c3-ad19-b96499c3b471 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:03.984710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7b73ea4b-0c43-41c3-ad19-b96499c3b471 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:04.049015 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f50745d3-10f8-4bb4-868e-0b000dad365c tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121505 May 10 16:49:04.050323 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 76/147] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:49:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 16:49:04.063093 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0c169dd0-eadd-49dc-a104-0c06c38361f6 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:04.064374 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0c169dd0-eadd-49dc-a104-0c06c38361f6 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:04.152499 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-0c169dd0-eadd-49dc-a104-0c06c38361f6 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:04.161414 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0c169dd0-eadd-49dc-a104-0c06c38361f6 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1213 microversion: 2.1 time: 0.103343 May 10 16:49:04.162013 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 77/148] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:04 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:04.275873 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ead492e9-75ce-4439-bf97-389dca52f0bb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:04.276110 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ead492e9-75ce-4439-bf97-389dca52f0bb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:04.283228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7b73ea4b-0c43-41c3-ad19-b96499c3b471 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:04.292959 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7b73ea4b-0c43-41c3-ad19-b96499c3b471 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.330441 May 10 16:49:04.312373 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ead492e9-75ce-4439-bf97-389dca52f0bb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:04.327201 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ead492e9-75ce-4439-bf97-389dca52f0bb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:04.331918 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ead492e9-75ce-4439-bf97-389dca52f0bb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:04.332832 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ead492e9-75ce-4439-bf97-389dca52f0bb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:04.353652 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 72/149] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:03 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:04.612315 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-df69ba5a-1db9-4c65-83e3-9e6c8dffc81b req-40a9e86c-d795-43a9-bd0a-76000276913e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b9076f-b216-4383-b9fd-80b05ada72a8", "tag": "0ead7ac5-4337-4cb0-99ac-13f8b389ddd0"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:04.624479 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-df69ba5a-1db9-4c65-83e3-9e6c8dffc81b req-40a9e86c-d795-43a9-bd0a-76000276913e service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:04.624895 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-df69ba5a-1db9-4c65-83e3-9e6c8dffc81b req-40a9e86c-d795-43a9-bd0a-76000276913e service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:04.662351 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-df69ba5a-1db9-4c65-83e3-9e6c8dffc81b req-40a9e86c-d795-43a9-bd0a-76000276913e service nova] Creating event network-changed:0ead7ac5-4337-4cb0-99ac-13f8b389ddd0 for instance a2b9076f-b216-4383-b9fd-80b05ada72a8 on hv-cinder-83588 May 10 16:49:04.663990 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ead492e9-75ce-4439-bf97-389dca52f0bb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:04.673204 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ead492e9-75ce-4439-bf97-389dca52f0bb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:04.673373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-df69ba5a-1db9-4c65-83e3-9e6c8dffc81b req-40a9e86c-d795-43a9-bd0a-76000276913e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064300 May 10 16:49:04.674324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 73/150] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:49:04.678722 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ead492e9-75ce-4439-bf97-389dca52f0bb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:04.679870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ead492e9-75ce-4439-bf97-389dca52f0bb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1407 microversion: 2.20 time: 0.410985 May 10 16:49:04.680761 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 78/151] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:49:04 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:05.184045 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-22cba781-fcf8-4e0d-b9f3-d34468c34918 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:05.185669 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-22cba781-fcf8-4e0d-b9f3-d34468c34918 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:05.204566 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22cba781-fcf8-4e0d-b9f3-d34468c34918 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:05.205316 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22cba781-fcf8-4e0d-b9f3-d34468c34918 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:05.206311 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22cba781-fcf8-4e0d-b9f3-d34468c34918 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:05.206944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22cba781-fcf8-4e0d-b9f3-d34468c34918 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:05.311230 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-50b5be34-6a82-4db0-88b2-ce83c398f7ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:05.312309 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-50b5be34-6a82-4db0-88b2-ce83c398f7ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:05.327664 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-50b5be34-6a82-4db0-88b2-ce83c398f7ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:05.328131 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-50b5be34-6a82-4db0-88b2-ce83c398f7ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:05.329006 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-50b5be34-6a82-4db0-88b2-ce83c398f7ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:05.329528 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-50b5be34-6a82-4db0-88b2-ce83c398f7ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:05.377695 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-22cba781-fcf8-4e0d-b9f3-d34468c34918 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:05.409102 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-22cba781-fcf8-4e0d-b9f3-d34468c34918 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1265 microversion: 2.1 time: 0.228018 May 10 16:49:05.410347 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 74/152] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:05 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:05.700389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-21c587bc-22e9-4176-b982-c3641c22b0e5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:05.702285 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-21c587bc-22e9-4176-b982-c3641c22b0e5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:05.712404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21c587bc-22e9-4176-b982-c3641c22b0e5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:05.713178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21c587bc-22e9-4176-b982-c3641c22b0e5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:05.714903 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21c587bc-22e9-4176-b982-c3641c22b0e5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:05.715702 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21c587bc-22e9-4176-b982-c3641c22b0e5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:06.025638 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-21c587bc-22e9-4176-b982-c3641c22b0e5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:06.035470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-21c587bc-22e9-4176-b982-c3641c22b0e5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:06.038029 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-21c587bc-22e9-4176-b982-c3641c22b0e5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:06.039815 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-21c587bc-22e9-4176-b982-c3641c22b0e5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1598 microversion: 2.20 time: 0.343532 May 10 16:49:06.040980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 75/153] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:49:05 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1598 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:06.045354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-50b5be34-6a82-4db0-88b2-ce83c398f7ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:06.053985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-50b5be34-6a82-4db0-88b2-ce83c398f7ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.747416 May 10 16:49:06.059929 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-23fc5a0a-275f-4eef-ae1d-df8aaa07f741 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:06.060797 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-23fc5a0a-275f-4eef-ae1d-df8aaa07f741 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:06.063758 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 79/154] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:05 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:06.069539 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f27dcfa1-63de-4818-af8d-055163ee2d1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:06.070144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-23fc5a0a-275f-4eef-ae1d-df8aaa07f741 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:06.070541 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f27dcfa1-63de-4818-af8d-055163ee2d1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:06.070672 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-23fc5a0a-275f-4eef-ae1d-df8aaa07f741 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:06.071540 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-23fc5a0a-275f-4eef-ae1d-df8aaa07f741 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:06.072979 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-23fc5a0a-275f-4eef-ae1d-df8aaa07f741 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:06.077488 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f27dcfa1-63de-4818-af8d-055163ee2d1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:06.077988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f27dcfa1-63de-4818-af8d-055163ee2d1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:06.079122 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f27dcfa1-63de-4818-af8d-055163ee2d1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:06.079881 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f27dcfa1-63de-4818-af8d-055163ee2d1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:06.107458 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-23fc5a0a-275f-4eef-ae1d-df8aaa07f741 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:49:06.276460 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f27dcfa1-63de-4818-af8d-055163ee2d1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.211210 May 10 16:49:06.277286 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 80/155] 10.222.0.48 () {60 vars in 1315 bytes} [Tue May 10 16:49:06 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:49:06.319503 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-23fc5a0a-275f-4eef-ae1d-df8aaa07f741 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 204 len: 0 microversion: 2.1 time: 0.276814 May 10 16:49:06.323650 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 76/156] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:49:06 2022] DELETE /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:49:06.336167 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3234b5c3-b04b-49a2-8e03-97a13408ea78 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:06.337268 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3234b5c3-b04b-49a2-8e03-97a13408ea78 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:06.347879 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3234b5c3-b04b-49a2-8e03-97a13408ea78 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:06.348403 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3234b5c3-b04b-49a2-8e03-97a13408ea78 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:06.349205 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3234b5c3-b04b-49a2-8e03-97a13408ea78 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:06.350599 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3234b5c3-b04b-49a2-8e03-97a13408ea78 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:06.427661 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-667a8726-c5d3-4176-b7cc-4ef39ea2fab4 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:06.428490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-667a8726-c5d3-4176-b7cc-4ef39ea2fab4 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:06.435178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-667a8726-c5d3-4176-b7cc-4ef39ea2fab4 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:06.435629 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-667a8726-c5d3-4176-b7cc-4ef39ea2fab4 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:06.436454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-667a8726-c5d3-4176-b7cc-4ef39ea2fab4 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:06.436891 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-667a8726-c5d3-4176-b7cc-4ef39ea2fab4 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:06.727301 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3234b5c3-b04b-49a2-8e03-97a13408ea78 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:06.743017 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3234b5c3-b04b-49a2-8e03-97a13408ea78 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1553 microversion: 2.1 time: 0.412963 May 10 16:49:06.745972 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 81/157] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:06 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1553 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:06.781045 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-667a8726-c5d3-4176-b7cc-4ef39ea2fab4 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:06.792949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-667a8726-c5d3-4176-b7cc-4ef39ea2fab4 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1271 microversion: 2.1 time: 0.368876 May 10 16:49:06.805795 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 77/158] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:06 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1271 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:07.076053 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-50b36b89-60b3-4896-a1fb-a9774eb2007b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:07.076053 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-50b36b89-60b3-4896-a1fb-a9774eb2007b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:07.087803 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-50b36b89-60b3-4896-a1fb-a9774eb2007b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:07.090092 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-50b36b89-60b3-4896-a1fb-a9774eb2007b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:07.091419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-50b36b89-60b3-4896-a1fb-a9774eb2007b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:07.092657 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-50b36b89-60b3-4896-a1fb-a9774eb2007b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:07.314463 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-50b36b89-60b3-4896-a1fb-a9774eb2007b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:07.323125 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-50b36b89-60b3-4896-a1fb-a9774eb2007b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.255793 May 10 16:49:07.323980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 82/159] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:07 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:07.762018 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7e8a310e-291f-4f4d-8aad-b15d8c70fd6f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:07.763304 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7e8a310e-291f-4f4d-8aad-b15d8c70fd6f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:07.770388 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7e8a310e-291f-4f4d-8aad-b15d8c70fd6f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:07.770833 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7e8a310e-291f-4f4d-8aad-b15d8c70fd6f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:07.772401 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7e8a310e-291f-4f4d-8aad-b15d8c70fd6f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:07.773016 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7e8a310e-291f-4f4d-8aad-b15d8c70fd6f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:07.813902 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-247f9bf9-f197-42b1-ae63-e3917aea7e68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:07.815058 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-247f9bf9-f197-42b1-ae63-e3917aea7e68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:07.829703 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-247f9bf9-f197-42b1-ae63-e3917aea7e68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:07.830358 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-247f9bf9-f197-42b1-ae63-e3917aea7e68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:07.833769 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-247f9bf9-f197-42b1-ae63-e3917aea7e68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:07.839438 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-247f9bf9-f197-42b1-ae63-e3917aea7e68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:08.049858 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7e8a310e-291f-4f4d-8aad-b15d8c70fd6f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:08.062912 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7e8a310e-291f-4f4d-8aad-b15d8c70fd6f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1553 microversion: 2.1 time: 0.304657 May 10 16:49:08.066134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 78/160] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:07 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1553 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:08.238122 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-247f9bf9-f197-42b1-ae63-e3917aea7e68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:08.247839 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-247f9bf9-f197-42b1-ae63-e3917aea7e68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1313 microversion: 2.1 time: 0.438162 May 10 16:49:08.249169 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 83/161] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:07 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:08.254733 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-b89f27b0-38bb-4d04-8f07-5d7a495609d4 req-f42adf90-2036-47a0-a6d3-484cefc45166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6739110-4e68-4993-83ec-7c1503f7b87b", "tag": "494f67f0-21ef-40e7-8bd0-9ab88f71dbef"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:08.267121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-b89f27b0-38bb-4d04-8f07-5d7a495609d4 req-f42adf90-2036-47a0-a6d3-484cefc45166 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:08.267564 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-b89f27b0-38bb-4d04-8f07-5d7a495609d4 req-f42adf90-2036-47a0-a6d3-484cefc45166 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:08.282613 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-b89f27b0-38bb-4d04-8f07-5d7a495609d4 req-f42adf90-2036-47a0-a6d3-484cefc45166 service nova] Creating event network-changed:494f67f0-21ef-40e7-8bd0-9ab88f71dbef for instance c6739110-4e68-4993-83ec-7c1503f7b87b on hv-cinder-83588 May 10 16:49:08.291613 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-b89f27b0-38bb-4d04-8f07-5d7a495609d4 req-f42adf90-2036-47a0-a6d3-484cefc45166 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040290 May 10 16:49:08.295142 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 79/162] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:49:08.341756 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d15417a8-dab0-438e-b419-31466dc3f46c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:08.342767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d15417a8-dab0-438e-b419-31466dc3f46c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:08.349175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d15417a8-dab0-438e-b419-31466dc3f46c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:08.350798 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d15417a8-dab0-438e-b419-31466dc3f46c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:08.355994 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d15417a8-dab0-438e-b419-31466dc3f46c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:08.358008 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d15417a8-dab0-438e-b419-31466dc3f46c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:09.039376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d15417a8-dab0-438e-b419-31466dc3f46c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:09.050744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d15417a8-dab0-438e-b419-31466dc3f46c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.712937 May 10 16:49:09.052086 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 84/163] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:08 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:09.084426 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8e215d68-7618-4e8c-b918-78b89d56cbe2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:09.085859 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8e215d68-7618-4e8c-b918-78b89d56cbe2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:09.100828 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8e215d68-7618-4e8c-b918-78b89d56cbe2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:09.102052 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8e215d68-7618-4e8c-b918-78b89d56cbe2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:09.104127 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8e215d68-7618-4e8c-b918-78b89d56cbe2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:09.107287 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8e215d68-7618-4e8c-b918-78b89d56cbe2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:09.204576 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8e215d68-7618-4e8c-b918-78b89d56cbe2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:09.214707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8e215d68-7618-4e8c-b918-78b89d56cbe2 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1511 microversion: 2.1 time: 0.134572 May 10 16:49:09.217504 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 80/164] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:09 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1511 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:09.267776 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3362b395-46c0-4dea-8ee6-7af76eee6989 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:09.268421 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3362b395-46c0-4dea-8ee6-7af76eee6989 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:09.281250 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3362b395-46c0-4dea-8ee6-7af76eee6989 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:09.282201 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3362b395-46c0-4dea-8ee6-7af76eee6989 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:09.283295 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3362b395-46c0-4dea-8ee6-7af76eee6989 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:09.283910 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3362b395-46c0-4dea-8ee6-7af76eee6989 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:09.608912 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-4839ea9b-ca70-4f76-ad4b-32665da9e0aa req-520c779b-0d1f-461e-9b61-dbea4262a541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad4075b5-60fe-448e-bf81-e15ef0d7696b", "tag": "e57f2759-ae5d-4dd6-bdb4-4d2426adf577"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:09.635156 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-4839ea9b-ca70-4f76-ad4b-32665da9e0aa req-520c779b-0d1f-461e-9b61-dbea4262a541 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:09.640671 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-4839ea9b-ca70-4f76-ad4b-32665da9e0aa req-520c779b-0d1f-461e-9b61-dbea4262a541 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:09.691062 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-4839ea9b-ca70-4f76-ad4b-32665da9e0aa req-520c779b-0d1f-461e-9b61-dbea4262a541 service nova] Creating event network-changed:e57f2759-ae5d-4dd6-bdb4-4d2426adf577 for instance ad4075b5-60fe-448e-bf81-e15ef0d7696b on hv-cinder-83588 May 10 16:49:09.704980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-4839ea9b-ca70-4f76-ad4b-32665da9e0aa req-520c779b-0d1f-461e-9b61-dbea4262a541 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135634 May 10 16:49:09.709814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 81/165] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:09.814549 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3362b395-46c0-4dea-8ee6-7af76eee6989 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:09.828965 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3362b395-46c0-4dea-8ee6-7af76eee6989 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1313 microversion: 2.1 time: 0.566483 May 10 16:49:09.832324 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 85/166] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:09 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:10.071913 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-1e56af38-fa7f-48c5-bd3c-b4520cf72227 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:10.072966 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-1e56af38-fa7f-48c5-bd3c-b4520cf72227 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:10.091894 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1e56af38-fa7f-48c5-bd3c-b4520cf72227 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:10.093110 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1e56af38-fa7f-48c5-bd3c-b4520cf72227 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:10.095991 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1e56af38-fa7f-48c5-bd3c-b4520cf72227 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:10.097079 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1e56af38-fa7f-48c5-bd3c-b4520cf72227 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:10.254218 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:10.255236 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:10.301971 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:10.302907 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:10.304408 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:10.305179 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:10.390772 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-1e56af38-fa7f-48c5-bd3c-b4520cf72227 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:10.410077 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-1e56af38-fa7f-48c5-bd3c-b4520cf72227 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.345559 May 10 16:49:10.412796 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 82/167] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:10 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:10.423151 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-6306cad3-dad7-42c7-a9d1-c1873b634eea req-fd9a9186-50b3-4910-a3a3-f479a4cad74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0c17d0-fd7d-4f22-a89c-bc390a1cc535", "name": "network-vif-deleted", "tag": "49626576-c69c-48d0-8b3d-be4360ede3a8"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:10.434300 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:10.434947 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:10.435577 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lazy-loading 'fault' on Instance uuid 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:49:10.453527 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-6306cad3-dad7-42c7-a9d1-c1873b634eea req-fd9a9186-50b3-4910-a3a3-f479a4cad74f service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:10.460978 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-6306cad3-dad7-42c7-a9d1-c1873b634eea req-fd9a9186-50b3-4910-a3a3-f479a4cad74f service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:10.510892 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-6306cad3-dad7-42c7-a9d1-c1873b634eea req-fd9a9186-50b3-4910-a3a3-f479a4cad74f service nova] Creating event network-vif-deleted:49626576-c69c-48d0-8b3d-be4360ede3a8 for instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 on hv-cinder-83588 May 10 16:49:10.540389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-6306cad3-dad7-42c7-a9d1-c1873b634eea req-fd9a9186-50b3-4910-a3a3-f479a4cad74f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124349 May 10 16:49:10.541211 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 83/168] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:10.572251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fabe073e2f4fa1bfb6c5fbaf859eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60f85e7bbb38404ba6b68eff605a3306', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:10.582129 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-784ca0c6-eb86-4ab8-ba13-d1d2823f84da tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 200 len: 1305 microversion: 2.1 time: 0.351674 May 10 16:49:10.585389 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 86/169] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:10 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 1305 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:10.864937 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2d9c099f-23bb-4e9b-803e-89bcf83603fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:10.868739 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2d9c099f-23bb-4e9b-803e-89bcf83603fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:10.884369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d9c099f-23bb-4e9b-803e-89bcf83603fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:10.884939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d9c099f-23bb-4e9b-803e-89bcf83603fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:10.885842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d9c099f-23bb-4e9b-803e-89bcf83603fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:10.886551 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d9c099f-23bb-4e9b-803e-89bcf83603fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:11.046780 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2d9c099f-23bb-4e9b-803e-89bcf83603fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:11.055164 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2d9c099f-23bb-4e9b-803e-89bcf83603fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1313 microversion: 2.1 time: 0.206362 May 10 16:49:11.055798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 84/170] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:10 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:11.441096 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8486bacc-ec0e-4ba3-88ac-62e007fb2505 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:11.441855 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8486bacc-ec0e-4ba3-88ac-62e007fb2505 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:11.448511 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8486bacc-ec0e-4ba3-88ac-62e007fb2505 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:11.448961 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8486bacc-ec0e-4ba3-88ac-62e007fb2505 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:11.449728 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8486bacc-ec0e-4ba3-88ac-62e007fb2505 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:11.450159 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8486bacc-ec0e-4ba3-88ac-62e007fb2505 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:11.610976 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d3178c28-90f2-41cf-ac82-83ae1c831026 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:11.611592 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d3178c28-90f2-41cf-ac82-83ae1c831026 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:11.619711 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d3178c28-90f2-41cf-ac82-83ae1c831026 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:11.620171 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d3178c28-90f2-41cf-ac82-83ae1c831026 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:11.620990 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d3178c28-90f2-41cf-ac82-83ae1c831026 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:11.621107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8486bacc-ec0e-4ba3-88ac-62e007fb2505 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:11.621430 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d3178c28-90f2-41cf-ac82-83ae1c831026 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:11.636644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8486bacc-ec0e-4ba3-88ac-62e007fb2505 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.199342 May 10 16:49:11.647238 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 87/171] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:11 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-d3178c28-90f2-41cf-ac82-83ae1c831026 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] HTTP exception thrown: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d3178c28-90f2-41cf-ac82-83ae1c831026 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Request method failure captured: May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 HTTP/1.1 May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepdEUpd9yq82Xce8sDya5lF7cMqhiMf0GCCIi9SouA8Sv_RCbG2l8ufDd4q61H-_g69P-ZX6dVErs0gP3Nda67uAQ5LCDAXQexq01sFUWfuOm9eMoAltIo0JrcflFlZVWKtPvK5PpYmAkAjr8DSxJpaPGS73RuFdJRORdqzTicTX4UM May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: 60f85e7bbb38404ba6b68eff605a3306 May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:49:11.647845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: 60f85e7bbb38404ba6b68eff605a3306 May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-DeleteServersTestJSON-1477028676-project May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: f4fabe073e2f4fa1bfb6c5fbaf859eac May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-DeleteServersTestJSON-1477028676-project May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:11.649404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '9e0c17d0-fd7d-4f22-a89c-bc390a1cc535'} May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:49:11.650532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:11.652145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:49:11.653678 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d3178c28-90f2-41cf-ac82-83ae1c831026 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Returning 404 to user: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:49:11.653678 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d3178c28-90f2-41cf-ac82-83ae1c831026 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 404 len: 111 microversion: 2.1 time: 0.042950 May 10 16:49:11.653678 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 85/172] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:11 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:49:11.776935 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1b46253e-62c8-45ba-aed7-c890e8ced892 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:11.777961 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1b46253e-62c8-45ba-aed7-c890e8ced892 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:11.791291 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1b46253e-62c8-45ba-aed7-c890e8ced892 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:11.791743 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1b46253e-62c8-45ba-aed7-c890e8ced892 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:11.792727 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1b46253e-62c8-45ba-aed7-c890e8ced892 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:11.793312 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1b46253e-62c8-45ba-aed7-c890e8ced892 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:11.819902 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-1b46253e-62c8-45ba-aed7-c890e8ced892 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] HTTP exception thrown: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1b46253e-62c8-45ba-aed7-c890e8ced892 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Request method failure captured: May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535/os-volume_attachments HTTP/1.1 May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdEUpd9yq82Xce8sDya5lF7cMqhiMf0GCCIi9SouA8Sv_RCbG2l8ufDd4q61H-_g69P-ZX6dVErs0gP3Nda67uAQ5LCDAXQexq01sFUWfuOm9eMoAltIo0JrcflFlZVWKtPvK5PpYmAkAjr8DSxJpaPGS73RuFdJRORdqzTicTX4UM May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 60f85e7bbb38404ba6b68eff605a3306 May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:49:11.826364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 60f85e7bbb38404ba6b68eff605a3306 May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-DeleteServersTestJSON-1477028676-project May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: f4fabe073e2f4fa1bfb6c5fbaf859eac May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-DeleteServersTestJSON-1477028676-project May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:11.828647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'server_id': '9e0c17d0-fd7d-4f22-a89c-bc390a1cc535'} May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:49:11.830232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:11.831846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:11.834113 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1b46253e-62c8-45ba-aed7-c890e8ced892 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Returning 404 to user: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:49:11.834113 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1b46253e-62c8-45ba-aed7-c890e8ced892 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.058788 May 10 16:49:11.834113 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 88/173] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:49:11 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:49:12.071701 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cd1ce17b-1de3-427d-b9e8-1fdb9768c652 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:12.072464 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cd1ce17b-1de3-427d-b9e8-1fdb9768c652 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:12.096601 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd1ce17b-1de3-427d-b9e8-1fdb9768c652 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:12.097041 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd1ce17b-1de3-427d-b9e8-1fdb9768c652 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:12.100460 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd1ce17b-1de3-427d-b9e8-1fdb9768c652 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:12.100946 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd1ce17b-1de3-427d-b9e8-1fdb9768c652 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:12.404870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cd1ce17b-1de3-427d-b9e8-1fdb9768c652 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:12.416521 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cd1ce17b-1de3-427d-b9e8-1fdb9768c652 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1313 microversion: 2.1 time: 0.349399 May 10 16:49:12.417691 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 86/174] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:12 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:12.655804 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-230ecace-0436-4007-bd35-4cee88a92fd7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:12.656493 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-230ecace-0436-4007-bd35-4cee88a92fd7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:12.666734 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-230ecace-0436-4007-bd35-4cee88a92fd7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:12.668921 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-230ecace-0436-4007-bd35-4cee88a92fd7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:12.670264 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-230ecace-0436-4007-bd35-4cee88a92fd7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:12.670613 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-230ecace-0436-4007-bd35-4cee88a92fd7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:13.023603 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-230ecace-0436-4007-bd35-4cee88a92fd7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:13.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-230ecace-0436-4007-bd35-4cee88a92fd7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.382552 May 10 16:49:13.036317 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 89/175] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:12 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:13.208628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6ce39702-1b2a-448b-8ea0-ffb35317031f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:13.209819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6ce39702-1b2a-448b-8ea0-ffb35317031f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:13.216072 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6ce39702-1b2a-448b-8ea0-ffb35317031f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:13.216554 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6ce39702-1b2a-448b-8ea0-ffb35317031f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:13.217645 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6ce39702-1b2a-448b-8ea0-ffb35317031f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:13.218095 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6ce39702-1b2a-448b-8ea0-ffb35317031f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:13.232083 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-6ce39702-1b2a-448b-8ea0-ffb35317031f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] HTTP exception thrown: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6ce39702-1b2a-448b-8ea0-ffb35317031f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Request method failure captured: May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: DELETE /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 HTTP/1.1 May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepdEUpd9yq82Xce8sDya5lF7cMqhiMf0GCCIi9SouA8Sv_RCbG2l8ufDd4q61H-_g69P-ZX6dVErs0gP3Nda67uAQ5LCDAXQexq01sFUWfuOm9eMoAltIo0JrcflFlZVWKtPvK5PpYmAkAjr8DSxJpaPGS73RuFdJRORdqzTicTX4UM May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: 60f85e7bbb38404ba6b68eff605a3306 May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:49:13.233794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: 60f85e7bbb38404ba6b68eff605a3306 May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-DeleteServersTestJSON-1477028676-project May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: f4fabe073e2f4fa1bfb6c5fbaf859eac May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-DeleteServersTestJSON-1477028676-project May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:13.235218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '9e0c17d0-fd7d-4f22-a89c-bc390a1cc535'} May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:49:13.236053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:13.237821 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:49:13.239242 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6ce39702-1b2a-448b-8ea0-ffb35317031f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Returning 404 to user: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:49:13.239242 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6ce39702-1b2a-448b-8ea0-ffb35317031f tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 404 len: 111 microversion: 2.1 time: 0.030720 May 10 16:49:13.239242 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 87/176] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:49:13 2022] DELETE /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:49:13.244094 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4d99c4c6-77f5-4d4f-a91d-5325d2c12d19 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:13.244820 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4d99c4c6-77f5-4d4f-a91d-5325d2c12d19 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] [instance: 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:13.251208 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4d99c4c6-77f5-4d4f-a91d-5325d2c12d19 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:13.251736 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4d99c4c6-77f5-4d4f-a91d-5325d2c12d19 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:13.252616 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4d99c4c6-77f5-4d4f-a91d-5325d2c12d19 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:13.253149 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4d99c4c6-77f5-4d4f-a91d-5325d2c12d19 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:13.267834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-4d99c4c6-77f5-4d4f-a91d-5325d2c12d19 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] HTTP exception thrown: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4d99c4c6-77f5-4d4f-a91d-5325d2c12d19 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Request method failure captured: May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 HTTP/1.1 May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdEUpd9yq82Xce8sDya5lF7cMqhiMf0GCCIi9SouA8Sv_RCbG2l8ufDd4q61H-_g69P-ZX6dVErs0gP3Nda67uAQ5LCDAXQexq01sFUWfuOm9eMoAltIo0JrcflFlZVWKtPvK5PpYmAkAjr8DSxJpaPGS73RuFdJRORdqzTicTX4UM May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 60f85e7bbb38404ba6b68eff605a3306 May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:49:13.270190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_60f85e7bbb38404ba6b68eff605a3306"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 60f85e7bbb38404ba6b68eff605a3306 May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-DeleteServersTestJSON-1477028676 May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-DeleteServersTestJSON-1477028676-project May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: f4fabe073e2f4fa1bfb6c5fbaf859eac May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-DeleteServersTestJSON-1477028676-project May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:13.272600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '9e0c17d0-fd7d-4f22-a89c-bc390a1cc535'} May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:49:13.273487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. May 10 16:49:13.274985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:13.276318 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4d99c4c6-77f5-4d4f-a91d-5325d2c12d19 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] Returning 404 to user: Instance 9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:49:13.276318 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4d99c4c6-77f5-4d4f-a91d-5325d2c12d19 tempest-DeleteServersTestJSON-1477028676 tempest-DeleteServersTestJSON-1477028676-project] 10.222.0.48 "GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535" status: 404 len: 111 microversion: 2.1 time: 0.034183 May 10 16:49:13.276318 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 90/177] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:13 2022] GET /compute/v2.1/servers/9e0c17d0-fd7d-4f22-a89c-bc390a1cc535 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:49:13.434326 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-41f27eaf-7e94-4daf-b403-3a8f11f1ca65 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:13.434937 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-41f27eaf-7e94-4daf-b403-3a8f11f1ca65 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:13.441462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-41f27eaf-7e94-4daf-b403-3a8f11f1ca65 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:13.441916 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-41f27eaf-7e94-4daf-b403-3a8f11f1ca65 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:13.442741 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-41f27eaf-7e94-4daf-b403-3a8f11f1ca65 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:13.443197 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-41f27eaf-7e94-4daf-b403-3a8f11f1ca65 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:13.673281 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-41f27eaf-7e94-4daf-b403-3a8f11f1ca65 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:13.683605 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-41f27eaf-7e94-4daf-b403-3a8f11f1ca65 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1313 microversion: 2.1 time: 0.252517 May 10 16:49:13.689240 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 88/178] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:13 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:14.051621 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-eb497556-1bfd-4224-b87c-c11a48c757e0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:14.055716 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-eb497556-1bfd-4224-b87c-c11a48c757e0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:14.077075 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb497556-1bfd-4224-b87c-c11a48c757e0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:14.078315 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb497556-1bfd-4224-b87c-c11a48c757e0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:14.086753 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb497556-1bfd-4224-b87c-c11a48c757e0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:14.087801 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb497556-1bfd-4224-b87c-c11a48c757e0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:14.147628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-151888e9-3289-4952-a9d3-26668fe4934f req-a18855bb-8949-413e-a4ea-55132de31b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4075b5-60fe-448e-bf81-e15ef0d7696b", "name": "network-vif-plugged", "status": "completed", "tag": "e57f2759-ae5d-4dd6-bdb4-4d2426adf577"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:14.172487 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-151888e9-3289-4952-a9d3-26668fe4934f req-a18855bb-8949-413e-a4ea-55132de31b05 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:14.172852 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-151888e9-3289-4952-a9d3-26668fe4934f req-a18855bb-8949-413e-a4ea-55132de31b05 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:14.206414 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-151888e9-3289-4952-a9d3-26668fe4934f req-a18855bb-8949-413e-a4ea-55132de31b05 service nova] Creating event network-vif-plugged:e57f2759-ae5d-4dd6-bdb4-4d2426adf577 for instance ad4075b5-60fe-448e-bf81-e15ef0d7696b on hv-cinder-83588 May 10 16:49:14.222980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-151888e9-3289-4952-a9d3-26668fe4934f req-a18855bb-8949-413e-a4ea-55132de31b05 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078820 May 10 16:49:14.224447 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 89/179] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:14.407491 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-eb497556-1bfd-4224-b87c-c11a48c757e0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:14.417798 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-eb497556-1bfd-4224-b87c-c11a48c757e0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.370197 May 10 16:49:14.419217 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 91/180] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:14 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:14.717934 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8397b1b9-5f2e-4500-b6c9-a13317545890 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:14.718831 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8397b1b9-5f2e-4500-b6c9-a13317545890 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:14.725582 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8397b1b9-5f2e-4500-b6c9-a13317545890 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:14.726189 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8397b1b9-5f2e-4500-b6c9-a13317545890 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:14.727073 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8397b1b9-5f2e-4500-b6c9-a13317545890 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:14.727508 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8397b1b9-5f2e-4500-b6c9-a13317545890 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:14.881585 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8397b1b9-5f2e-4500-b6c9-a13317545890 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:14.895320 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8397b1b9-5f2e-4500-b6c9-a13317545890 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1313 microversion: 2.1 time: 0.182949 May 10 16:49:14.899559 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 90/181] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:14 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:15.436445 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-25dc506b-e65c-4763-95f2-fbe4062b900b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:15.436965 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-25dc506b-e65c-4763-95f2-fbe4062b900b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:15.446590 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-25dc506b-e65c-4763-95f2-fbe4062b900b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:15.447217 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-25dc506b-e65c-4763-95f2-fbe4062b900b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:15.449502 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-25dc506b-e65c-4763-95f2-fbe4062b900b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:15.449948 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-25dc506b-e65c-4763-95f2-fbe4062b900b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:15.658654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-25dc506b-e65c-4763-95f2-fbe4062b900b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:15.669313 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-25dc506b-e65c-4763-95f2-fbe4062b900b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.234450 May 10 16:49:15.670949 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 92/182] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:15 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:15.919550 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-481c624c-436b-480b-adff-f1b94f1c585a tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:15.924160 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-481c624c-436b-480b-adff-f1b94f1c585a tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:15.936633 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-481c624c-436b-480b-adff-f1b94f1c585a tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:15.937275 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-481c624c-436b-480b-adff-f1b94f1c585a tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:15.938373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-481c624c-436b-480b-adff-f1b94f1c585a tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:15.939280 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-481c624c-436b-480b-adff-f1b94f1c585a tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.307302 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-481c624c-436b-480b-adff-f1b94f1c585a tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:16.317200 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-481c624c-436b-480b-adff-f1b94f1c585a tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1313 microversion: 2.1 time: 0.405963 May 10 16:49:16.328427 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 91/183] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:15 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:16.687593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-582d71f6-b391-48be-8bae-89e499efc359 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:16.688202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-582d71f6-b391-48be-8bae-89e499efc359 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:16.696072 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-582d71f6-b391-48be-8bae-89e499efc359 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:16.696560 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-582d71f6-b391-48be-8bae-89e499efc359 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.697343 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-582d71f6-b391-48be-8bae-89e499efc359 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:16.697782 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-582d71f6-b391-48be-8bae-89e499efc359 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.860137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-582d71f6-b391-48be-8bae-89e499efc359 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:16.869373 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-582d71f6-b391-48be-8bae-89e499efc359 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.185611 May 10 16:49:16.880355 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 93/184] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:16 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:17.337352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-33fbe163-5963-4154-8985-20b5e3677ff9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:17.338639 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-33fbe163-5963-4154-8985-20b5e3677ff9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:17.345578 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-33fbe163-5963-4154-8985-20b5e3677ff9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:17.346157 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-33fbe163-5963-4154-8985-20b5e3677ff9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:17.346986 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-33fbe163-5963-4154-8985-20b5e3677ff9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:17.347583 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-33fbe163-5963-4154-8985-20b5e3677ff9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:17.489608 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-33fbe163-5963-4154-8985-20b5e3677ff9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:17.499541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-33fbe163-5963-4154-8985-20b5e3677ff9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1497 microversion: 2.1 time: 0.166578 May 10 16:49:17.500107 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 92/185] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:17 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:17.887239 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-20a281b9-2eb4-40de-b438-44a00dd1139f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:17.887846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-20a281b9-2eb4-40de-b438-44a00dd1139f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:17.894920 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-20a281b9-2eb4-40de-b438-44a00dd1139f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:17.895565 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-20a281b9-2eb4-40de-b438-44a00dd1139f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:17.897345 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-20a281b9-2eb4-40de-b438-44a00dd1139f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:17.897791 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-20a281b9-2eb4-40de-b438-44a00dd1139f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:18.000055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-06411848-e606-4160-aa50-dbf648941f0b tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:18.000828 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-06411848-e606-4160-aa50-dbf648941f0b tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:18.011212 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-06411848-e606-4160-aa50-dbf648941f0b tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:18.011948 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-06411848-e606-4160-aa50-dbf648941f0b tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:18.012987 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-06411848-e606-4160-aa50-dbf648941f0b tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:18.013652 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-06411848-e606-4160-aa50-dbf648941f0b tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:18.048772 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-06411848-e606-4160-aa50-dbf648941f0b tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:49:18.157745 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-20a281b9-2eb4-40de-b438-44a00dd1139f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:18.175582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-20a281b9-2eb4-40de-b438-44a00dd1139f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.292193 May 10 16:49:18.178317 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 94/186] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:17 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:18.181399 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-06411848-e606-4160-aa50-dbf648941f0b tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 204 len: 0 microversion: 2.1 time: 0.181340 May 10 16:49:18.182174 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 93/187] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:49:17 2022] DELETE /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:49:18.203116 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ea033141-732c-4355-887e-fa707947bf20 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:18.204932 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ea033141-732c-4355-887e-fa707947bf20 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:18.212819 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ea033141-732c-4355-887e-fa707947bf20 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:18.213465 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ea033141-732c-4355-887e-fa707947bf20 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:18.214561 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ea033141-732c-4355-887e-fa707947bf20 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:18.215287 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ea033141-732c-4355-887e-fa707947bf20 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:18.389575 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ea033141-732c-4355-887e-fa707947bf20 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:18.400009 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ea033141-732c-4355-887e-fa707947bf20 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1503 microversion: 2.1 time: 0.205242 May 10 16:49:18.400807 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 95/188] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:18 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:19.196173 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6c038808-27da-4ce0-b6aa-1a75c76688dd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:19.197065 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6c038808-27da-4ce0-b6aa-1a75c76688dd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:19.203549 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6c038808-27da-4ce0-b6aa-1a75c76688dd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:19.204089 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6c038808-27da-4ce0-b6aa-1a75c76688dd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:19.204910 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6c038808-27da-4ce0-b6aa-1a75c76688dd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:19.205351 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6c038808-27da-4ce0-b6aa-1a75c76688dd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:19.399421 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6c038808-27da-4ce0-b6aa-1a75c76688dd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:19.410316 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6c038808-27da-4ce0-b6aa-1a75c76688dd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.218741 May 10 16:49:19.413044 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 94/189] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:19 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:19.418779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-cf6231d5-2fec-4226-8e9c-c7a67a586d12 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:19.419398 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-cf6231d5-2fec-4226-8e9c-c7a67a586d12 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:19.426482 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cf6231d5-2fec-4226-8e9c-c7a67a586d12 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:19.426935 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cf6231d5-2fec-4226-8e9c-c7a67a586d12 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:19.427792 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cf6231d5-2fec-4226-8e9c-c7a67a586d12 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:19.428227 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cf6231d5-2fec-4226-8e9c-c7a67a586d12 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:19.561278 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cf6231d5-2fec-4226-8e9c-c7a67a586d12 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:19.568952 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-cf6231d5-2fec-4226-8e9c-c7a67a586d12 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1503 microversion: 2.1 time: 0.154194 May 10 16:49:19.569539 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 96/190] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:19 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:20.431154 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0b5a5591-a482-4d8b-a5dc-c783e1c0083c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:20.432393 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0b5a5591-a482-4d8b-a5dc-c783e1c0083c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:20.441004 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0b5a5591-a482-4d8b-a5dc-c783e1c0083c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:20.442435 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0b5a5591-a482-4d8b-a5dc-c783e1c0083c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:20.444617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0b5a5591-a482-4d8b-a5dc-c783e1c0083c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:20.445938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0b5a5591-a482-4d8b-a5dc-c783e1c0083c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:20.586519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d1fabbd9-b131-4837-aece-47e5cd5f7024 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:20.587528 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d1fabbd9-b131-4837-aece-47e5cd5f7024 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:20.600076 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d1fabbd9-b131-4837-aece-47e5cd5f7024 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:20.601627 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d1fabbd9-b131-4837-aece-47e5cd5f7024 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:20.602807 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d1fabbd9-b131-4837-aece-47e5cd5f7024 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:20.603682 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d1fabbd9-b131-4837-aece-47e5cd5f7024 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:20.654646 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0b5a5591-a482-4d8b-a5dc-c783e1c0083c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:20.670036 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0b5a5591-a482-4d8b-a5dc-c783e1c0083c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.241982 May 10 16:49:20.670749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 95/191] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:20 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:20.678003 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-1c7f7609-1d8b-4530-b707-766bd50e0675 req-bee60e09-4691-48b5-aa75-e127065ad92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4075b5-60fe-448e-bf81-e15ef0d7696b", "name": "network-vif-deleted", "tag": "e57f2759-ae5d-4dd6-bdb4-4d2426adf577"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:20.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-1c7f7609-1d8b-4530-b707-766bd50e0675 req-bee60e09-4691-48b5-aa75-e127065ad92a service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:20.688383 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-1c7f7609-1d8b-4530-b707-766bd50e0675 req-bee60e09-4691-48b5-aa75-e127065ad92a service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:20.691845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d1fabbd9-b131-4837-aece-47e5cd5f7024 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:20.702509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-1c7f7609-1d8b-4530-b707-766bd50e0675 req-bee60e09-4691-48b5-aa75-e127065ad92a service nova] Creating event network-vif-deleted:e57f2759-ae5d-4dd6-bdb4-4d2426adf577 for instance ad4075b5-60fe-448e-bf81-e15ef0d7696b on hv-cinder-83588 May 10 16:49:20.708142 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-1c7f7609-1d8b-4530-b707-766bd50e0675 req-bee60e09-4691-48b5-aa75-e127065ad92a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034259 May 10 16:49:20.709628 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 96/192] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:20.712232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d1fabbd9-b131-4837-aece-47e5cd5f7024 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1461 microversion: 2.1 time: 0.129907 May 10 16:49:20.713955 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 97/193] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:20 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1461 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:21.688862 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-1488da2a-44cc-46a0-95ec-027cec7ba8a6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:21.689469 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-1488da2a-44cc-46a0-95ec-027cec7ba8a6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:21.696583 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1488da2a-44cc-46a0-95ec-027cec7ba8a6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:21.697039 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1488da2a-44cc-46a0-95ec-027cec7ba8a6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:21.697816 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1488da2a-44cc-46a0-95ec-027cec7ba8a6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:21.698255 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1488da2a-44cc-46a0-95ec-027cec7ba8a6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:21.729861 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1814980a-fb03-42e4-ab58-c9fc95b9cbc7 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:21.730599 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1814980a-fb03-42e4-ab58-c9fc95b9cbc7 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:21.737241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1814980a-fb03-42e4-ab58-c9fc95b9cbc7 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:21.737783 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1814980a-fb03-42e4-ab58-c9fc95b9cbc7 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:21.738631 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1814980a-fb03-42e4-ab58-c9fc95b9cbc7 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:21.739164 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1814980a-fb03-42e4-ab58-c9fc95b9cbc7 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:21.805906 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1814980a-fb03-42e4-ab58-c9fc95b9cbc7 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:21.813959 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1814980a-fb03-42e4-ab58-c9fc95b9cbc7 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1298 microversion: 2.1 time: 0.087970 May 10 16:49:21.814591 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 98/194] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:21 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:21.838790 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-1488da2a-44cc-46a0-95ec-027cec7ba8a6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:21.846911 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-1488da2a-44cc-46a0-95ec-027cec7ba8a6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.162386 May 10 16:49:21.847479 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 97/195] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:21 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:22.830779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-094473f1-d97e-4787-a02b-63602e683648 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:22.831306 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-094473f1-d97e-4787-a02b-63602e683648 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:22.838443 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-094473f1-d97e-4787-a02b-63602e683648 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:22.838899 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-094473f1-d97e-4787-a02b-63602e683648 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:22.839669 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-094473f1-d97e-4787-a02b-63602e683648 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:22.840110 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-094473f1-d97e-4787-a02b-63602e683648 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:22.862742 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e4f1b981-28da-4fd7-b019-630c5bd83331 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:22.863351 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e4f1b981-28da-4fd7-b019-630c5bd83331 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:22.869575 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4f1b981-28da-4fd7-b019-630c5bd83331 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:22.870037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4f1b981-28da-4fd7-b019-630c5bd83331 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:22.870813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4f1b981-28da-4fd7-b019-630c5bd83331 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:22.871256 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4f1b981-28da-4fd7-b019-630c5bd83331 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:22.909470 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-094473f1-d97e-4787-a02b-63602e683648 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:22.919521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-094473f1-d97e-4787-a02b-63602e683648 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 200 len: 1298 microversion: 2.1 time: 0.092258 May 10 16:49:22.922938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 99/196] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:22 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:23.009269 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e4f1b981-28da-4fd7-b019-630c5bd83331 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:23.018475 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e4f1b981-28da-4fd7-b019-630c5bd83331 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.159386 May 10 16:49:23.019294 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 98/197] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:22 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:23.936910 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f37105ba-146e-4220-9db7-66a2c74af8b8 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:23.937541 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f37105ba-146e-4220-9db7-66a2c74af8b8 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: ad4075b5-60fe-448e-bf81-e15ef0d7696b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:23.944642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f37105ba-146e-4220-9db7-66a2c74af8b8 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:23.945091 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f37105ba-146e-4220-9db7-66a2c74af8b8 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:23.945863 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f37105ba-146e-4220-9db7-66a2c74af8b8 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:23.946295 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f37105ba-146e-4220-9db7-66a2c74af8b8 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:23.959887 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-f37105ba-146e-4220-9db7-66a2c74af8b8 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] HTTP exception thrown: Instance ad4075b5-60fe-448e-bf81-e15ef0d7696b could not be found. May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f37105ba-146e-4220-9db7-66a2c74af8b8 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Request method failure captured: May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b HTTP/1.1 May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepd95jhyC3Fpml9zHXP-z-xfHe8eqoYzk0o9mw-DSo5RIUWXEBim_3I2Vs69D_3cA3bxo886_sEGBQOo4ioUbP75GzTva1zZUC49_agN62ZVEoj0Lmn5CxJvkEb-LpZod_rLGLQ118bUY8ziJw0Nj9MneAoDRDkxkJ_i_EMSh_eLuOA May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: d968e17fa36f403a923b7b42af28333d May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-VolumesActionsTest-271225975 May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:49:23.961601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d968e17fa36f403a923b7b42af28333d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d968e17fa36f403a923b7b42af28333d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d968e17fa36f403a923b7b42af28333d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d968e17fa36f403a923b7b42af28333d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-VolumesActionsTest-271225975 May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: d968e17fa36f403a923b7b42af28333d May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-VolumesActionsTest-271225975 May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-VolumesActionsTest-271225975-project May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 0cc5e5dfa3bb45c6bf8c4fcfcaadceec May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-VolumesActionsTest-271225975-project May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance ad4075b5-60fe-448e-bf81-e15ef0d7696b could not be found. May 10 16:49:23.962988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'ad4075b5-60fe-448e-bf81-e15ef0d7696b'} May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4075b5-60fe-448e-bf81-e15ef0d7696b could not be found. May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:49:23.963760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4075b5-60fe-448e-bf81-e15ef0d7696b could not be found. May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4075b5-60fe-448e-bf81-e15ef0d7696b could not be found. May 10 16:49:23.964843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:23.965956 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f37105ba-146e-4220-9db7-66a2c74af8b8 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Returning 404 to user: Instance ad4075b5-60fe-448e-bf81-e15ef0d7696b could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:49:23.965956 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f37105ba-146e-4220-9db7-66a2c74af8b8 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b" status: 404 len: 111 microversion: 2.1 time: 0.029821 May 10 16:49:23.965956 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 100/198] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:23 2022] GET /compute/v2.1/servers/ad4075b5-60fe-448e-bf81-e15ef0d7696b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 16:49:24.037985 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b9045d51-6abb-429f-b1cf-eca404e26f7b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:24.039081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b9045d51-6abb-429f-b1cf-eca404e26f7b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:24.049257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b9045d51-6abb-429f-b1cf-eca404e26f7b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:24.056629 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b9045d51-6abb-429f-b1cf-eca404e26f7b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:24.057612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b9045d51-6abb-429f-b1cf-eca404e26f7b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:24.058256 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b9045d51-6abb-429f-b1cf-eca404e26f7b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:24.080411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2121821291", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "networks": [{"uuid": "29cfe5c6-1718-45f0-8637-a49017b78c15"}]}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:24.155396 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.network.neutron [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] validate_networks() for [('29cfe5c6-1718-45f0-8637-a49017b78c15', None, None, None, None, None)] {{(pid=134195) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:49:24.230531 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b9045d51-6abb-429f-b1cf-eca404e26f7b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:24.245816 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b9045d51-6abb-429f-b1cf-eca404e26f7b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.213314 May 10 16:49:24.247517 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 99/199] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:24 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:24.571194 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Flavor limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:49:24.571194 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Image limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:49:24.571615 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Flavor pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:49:24.572014 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Image pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:49:24.572459 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:49:24.583101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:24.584393 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:24.585586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:24.586044 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:24.611202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Getting quotas for project d968e17fa36f403a923b7b42af28333d. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:49:24.616977 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Getting quotas for user 0cc5e5dfa3bb45c6bf8c4fcfcaadceec and project d968e17fa36f403a923b7b42af28333d. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:49:24.630451 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Going to run 1 instances... {{(pid=134195) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:49:24.632635 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134195) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:49:24.682972 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f83bb971-98fe-4add-a164-5d0cc9f9c3cb tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609392 May 10 16:49:24.683877 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 101/200] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 16:49:24.694444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3988e3a6-ad8a-434e-a8ca-b2c796ec18bf tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:24.695903 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3988e3a6-ad8a-434e-a8ca-b2c796ec18bf tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:24.758794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3988e3a6-ad8a-434e-a8ca-b2c796ec18bf tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:24.765281 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3988e3a6-ad8a-434e-a8ca-b2c796ec18bf tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1214 microversion: 2.1 time: 0.075291 May 10 16:49:24.765851 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 100/201] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:24 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:25.263665 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8a2225e6-cfe0-44fc-b3bb-20184bda3259 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:25.264834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8a2225e6-cfe0-44fc-b3bb-20184bda3259 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:25.273353 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8a2225e6-cfe0-44fc-b3bb-20184bda3259 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.273819 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8a2225e6-cfe0-44fc-b3bb-20184bda3259 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.274625 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8a2225e6-cfe0-44fc-b3bb-20184bda3259 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.275224 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8a2225e6-cfe0-44fc-b3bb-20184bda3259 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.466552 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8a2225e6-cfe0-44fc-b3bb-20184bda3259 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:25.477149 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8a2225e6-cfe0-44fc-b3bb-20184bda3259 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.217571 May 10 16:49:25.477734 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 102/202] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:25 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:25.791389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-fdaa1198-0c24-4408-bf21-0353dae323d2 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:25.794686 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-fdaa1198-0c24-4408-bf21-0353dae323d2 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:25.813005 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fdaa1198-0c24-4408-bf21-0353dae323d2 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.813516 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fdaa1198-0c24-4408-bf21-0353dae323d2 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.814403 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fdaa1198-0c24-4408-bf21-0353dae323d2 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.817413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fdaa1198-0c24-4408-bf21-0353dae323d2 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.909215 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-fdaa1198-0c24-4408-bf21-0353dae323d2 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:25.921717 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-fdaa1198-0c24-4408-bf21-0353dae323d2 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1266 microversion: 2.1 time: 0.142236 May 10 16:49:25.922550 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 101/203] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:25 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:26.495594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a862f3c1-6f51-4dbd-b06a-78482612bf8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:26.496207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a862f3c1-6f51-4dbd-b06a-78482612bf8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:26.503423 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a862f3c1-6f51-4dbd-b06a-78482612bf8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:26.503806 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a862f3c1-6f51-4dbd-b06a-78482612bf8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:26.504619 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a862f3c1-6f51-4dbd-b06a-78482612bf8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:26.505059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a862f3c1-6f51-4dbd-b06a-78482612bf8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:26.792641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a862f3c1-6f51-4dbd-b06a-78482612bf8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:26.806135 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a862f3c1-6f51-4dbd-b06a-78482612bf8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.314306 May 10 16:49:26.807536 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 103/204] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:26 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:26.939370 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-dba49917-59ce-4f6e-8bf4-6058d6ed2d68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:26.940672 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-dba49917-59ce-4f6e-8bf4-6058d6ed2d68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:26.953335 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dba49917-59ce-4f6e-8bf4-6058d6ed2d68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:26.954042 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dba49917-59ce-4f6e-8bf4-6058d6ed2d68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:26.955025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dba49917-59ce-4f6e-8bf4-6058d6ed2d68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:26.956790 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dba49917-59ce-4f6e-8bf4-6058d6ed2d68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:27.235572 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-dba49917-59ce-4f6e-8bf4-6058d6ed2d68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:27.251710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-dba49917-59ce-4f6e-8bf4-6058d6ed2d68 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1314 microversion: 2.1 time: 0.316090 May 10 16:49:27.264392 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 102/205] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:26 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:27.824838 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d6fd546a-06e0-400a-a5f2-919bb5619ac1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:27.825555 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d6fd546a-06e0-400a-a5f2-919bb5619ac1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:27.835865 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d6fd546a-06e0-400a-a5f2-919bb5619ac1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:27.836360 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d6fd546a-06e0-400a-a5f2-919bb5619ac1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:27.837156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d6fd546a-06e0-400a-a5f2-919bb5619ac1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:27.838011 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d6fd546a-06e0-400a-a5f2-919bb5619ac1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:28.183976 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-302baf57-a2f7-4ef5-ae96-e7c9484b7da1 req-1741b1e4-4fd9-4d64-9f1a-584021459c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717", "tag": "fd783ff0-31a4-4db4-a3b8-f7356a3f38bd"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:28.213942 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d6fd546a-06e0-400a-a5f2-919bb5619ac1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:28.237471 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d6fd546a-06e0-400a-a5f2-919bb5619ac1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.417572 May 10 16:49:28.240515 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 104/206] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:27 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:28.246203 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-302baf57-a2f7-4ef5-ae96-e7c9484b7da1 req-1741b1e4-4fd9-4d64-9f1a-584021459c03 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:28.246653 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-302baf57-a2f7-4ef5-ae96-e7c9484b7da1 req-1741b1e4-4fd9-4d64-9f1a-584021459c03 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:28.274587 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d99666a7-61fc-4f0f-8ebb-96f777a767df tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:28.276414 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d99666a7-61fc-4f0f-8ebb-96f777a767df tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:28.285712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d99666a7-61fc-4f0f-8ebb-96f777a767df tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:28.289649 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d99666a7-61fc-4f0f-8ebb-96f777a767df tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:28.291110 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d99666a7-61fc-4f0f-8ebb-96f777a767df tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:28.297058 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d99666a7-61fc-4f0f-8ebb-96f777a767df tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:28.309836 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-302baf57-a2f7-4ef5-ae96-e7c9484b7da1 req-1741b1e4-4fd9-4d64-9f1a-584021459c03 service nova] Creating event network-changed:fd783ff0-31a4-4db4-a3b8-f7356a3f38bd for instance b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 on hv-cinder-83588 May 10 16:49:28.331053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-302baf57-a2f7-4ef5-ae96-e7c9484b7da1 req-1741b1e4-4fd9-4d64-9f1a-584021459c03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143115 May 10 16:49:28.331803 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 103/207] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:28.858450 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d99666a7-61fc-4f0f-8ebb-96f777a767df tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:28.878322 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d99666a7-61fc-4f0f-8ebb-96f777a767df tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1314 microversion: 2.1 time: 0.608743 May 10 16:49:28.879240 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 105/208] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:28 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:29.260503 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6277a779-f1bf-4272-9766-13e07a769b6d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:29.261827 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6277a779-f1bf-4272-9766-13e07a769b6d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:29.268389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6277a779-f1bf-4272-9766-13e07a769b6d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:29.268816 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6277a779-f1bf-4272-9766-13e07a769b6d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:29.274502 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6277a779-f1bf-4272-9766-13e07a769b6d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:29.275142 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6277a779-f1bf-4272-9766-13e07a769b6d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:29.440788 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6277a779-f1bf-4272-9766-13e07a769b6d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:29.454394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6277a779-f1bf-4272-9766-13e07a769b6d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.198219 May 10 16:49:29.465015 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 104/209] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:29 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:29.898166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-39774f1f-3af7-42e0-960e-571e88a173a5 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:29.899428 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-39774f1f-3af7-42e0-960e-571e88a173a5 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:29.906573 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39774f1f-3af7-42e0-960e-571e88a173a5 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:29.907033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39774f1f-3af7-42e0-960e-571e88a173a5 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:29.907821 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39774f1f-3af7-42e0-960e-571e88a173a5 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:29.908558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39774f1f-3af7-42e0-960e-571e88a173a5 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:30.064671 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-39774f1f-3af7-42e0-960e-571e88a173a5 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:30.075548 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-39774f1f-3af7-42e0-960e-571e88a173a5 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1314 microversion: 2.1 time: 0.181833 May 10 16:49:30.076226 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 106/210] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:29 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:30.477005 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-77a4e313-30ef-478b-9923-086479f83dbf tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:30.479181 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-77a4e313-30ef-478b-9923-086479f83dbf tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:30.489193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-77a4e313-30ef-478b-9923-086479f83dbf tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:30.490589 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-77a4e313-30ef-478b-9923-086479f83dbf tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:30.491917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-77a4e313-30ef-478b-9923-086479f83dbf tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:30.492582 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-77a4e313-30ef-478b-9923-086479f83dbf tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:30.667706 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-77a4e313-30ef-478b-9923-086479f83dbf tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:30.678099 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-77a4e313-30ef-478b-9923-086479f83dbf tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.207922 May 10 16:49:30.682302 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 105/211] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:30 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:31.093452 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4e75f107-d8b0-4619-ad1c-39e2a20b0cd9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:31.094231 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4e75f107-d8b0-4619-ad1c-39e2a20b0cd9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:31.101091 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4e75f107-d8b0-4619-ad1c-39e2a20b0cd9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:31.101552 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4e75f107-d8b0-4619-ad1c-39e2a20b0cd9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:31.102343 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4e75f107-d8b0-4619-ad1c-39e2a20b0cd9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:31.102793 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4e75f107-d8b0-4619-ad1c-39e2a20b0cd9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:31.250279 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4e75f107-d8b0-4619-ad1c-39e2a20b0cd9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:31.261813 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4e75f107-d8b0-4619-ad1c-39e2a20b0cd9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1314 microversion: 2.1 time: 0.172171 May 10 16:49:31.262409 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 107/212] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:31 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:31.695286 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-19e29791-f14c-4c46-a68f-b5e6bb8b2cc0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:31.695857 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-19e29791-f14c-4c46-a68f-b5e6bb8b2cc0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:31.701943 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-19e29791-f14c-4c46-a68f-b5e6bb8b2cc0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:31.702421 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-19e29791-f14c-4c46-a68f-b5e6bb8b2cc0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:31.703202 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-19e29791-f14c-4c46-a68f-b5e6bb8b2cc0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:31.703638 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-19e29791-f14c-4c46-a68f-b5e6bb8b2cc0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:31.843140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-19e29791-f14c-4c46-a68f-b5e6bb8b2cc0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:31.851469 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-19e29791-f14c-4c46-a68f-b5e6bb8b2cc0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.160352 May 10 16:49:31.852055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 106/213] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:31 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:32.278266 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-530346cb-af33-4e6f-9097-93e78a973688 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:32.278875 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-530346cb-af33-4e6f-9097-93e78a973688 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:32.285346 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-530346cb-af33-4e6f-9097-93e78a973688 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:32.285802 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-530346cb-af33-4e6f-9097-93e78a973688 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:32.287352 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-530346cb-af33-4e6f-9097-93e78a973688 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:32.287793 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-530346cb-af33-4e6f-9097-93e78a973688 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:32.445550 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-530346cb-af33-4e6f-9097-93e78a973688 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:32.453244 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-530346cb-af33-4e6f-9097-93e78a973688 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1314 microversion: 2.1 time: 0.178756 May 10 16:49:32.453834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 108/214] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:32 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:32.868912 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6686d4ea-9403-45a3-ad02-12e4abd2cef9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:32.869636 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6686d4ea-9403-45a3-ad02-12e4abd2cef9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:32.875762 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6686d4ea-9403-45a3-ad02-12e4abd2cef9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:32.876195 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6686d4ea-9403-45a3-ad02-12e4abd2cef9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:32.877022 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6686d4ea-9403-45a3-ad02-12e4abd2cef9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:32.877457 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6686d4ea-9403-45a3-ad02-12e4abd2cef9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:33.016729 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6686d4ea-9403-45a3-ad02-12e4abd2cef9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:33.024715 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6686d4ea-9403-45a3-ad02-12e4abd2cef9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.159873 May 10 16:49:33.025373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 107/215] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:32 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:33.471376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7c998f59-6ff8-4eab-91a2-ea21ac4fdc14 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:33.472240 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7c998f59-6ff8-4eab-91a2-ea21ac4fdc14 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:33.482177 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7c998f59-6ff8-4eab-91a2-ea21ac4fdc14 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:33.483141 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7c998f59-6ff8-4eab-91a2-ea21ac4fdc14 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:33.483939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7c998f59-6ff8-4eab-91a2-ea21ac4fdc14 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:33.484601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7c998f59-6ff8-4eab-91a2-ea21ac4fdc14 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:33.663844 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7c998f59-6ff8-4eab-91a2-ea21ac4fdc14 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:33.679861 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7c998f59-6ff8-4eab-91a2-ea21ac4fdc14 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1314 microversion: 2.1 time: 0.212440 May 10 16:49:33.680504 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 109/216] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:33 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:34.046544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-fc542dd7-ddb8-4a87-9179-9cd36131aa2b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:34.047153 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-fc542dd7-ddb8-4a87-9179-9cd36131aa2b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:34.055225 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fc542dd7-ddb8-4a87-9179-9cd36131aa2b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:34.055738 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fc542dd7-ddb8-4a87-9179-9cd36131aa2b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:34.056549 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fc542dd7-ddb8-4a87-9179-9cd36131aa2b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:34.056989 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fc542dd7-ddb8-4a87-9179-9cd36131aa2b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:34.230004 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-fc542dd7-ddb8-4a87-9179-9cd36131aa2b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:34.240953 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-fc542dd7-ddb8-4a87-9179-9cd36131aa2b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.202508 May 10 16:49:34.248324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 108/217] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:34 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:34.696742 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-cf138070-3411-47d1-89a3-43909af6a6fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:34.698246 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-cf138070-3411-47d1-89a3-43909af6a6fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:34.710316 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cf138070-3411-47d1-89a3-43909af6a6fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:34.710849 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cf138070-3411-47d1-89a3-43909af6a6fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:34.712785 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cf138070-3411-47d1-89a3-43909af6a6fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:34.713986 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cf138070-3411-47d1-89a3-43909af6a6fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:35.014974 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cf138070-3411-47d1-89a3-43909af6a6fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:35.025966 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-cf138070-3411-47d1-89a3-43909af6a6fe tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1314 microversion: 2.1 time: 0.333666 May 10 16:49:35.027165 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 110/218] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:34 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:35.258711 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a6ad3f44-8983-4675-a9a9-666dede82c60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:35.259329 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a6ad3f44-8983-4675-a9a9-666dede82c60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:35.269185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a6ad3f44-8983-4675-a9a9-666dede82c60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:35.269900 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a6ad3f44-8983-4675-a9a9-666dede82c60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:35.270853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a6ad3f44-8983-4675-a9a9-666dede82c60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:35.271378 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a6ad3f44-8983-4675-a9a9-666dede82c60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:35.483466 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a6ad3f44-8983-4675-a9a9-666dede82c60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:35.494728 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a6ad3f44-8983-4675-a9a9-666dede82c60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.240338 May 10 16:49:35.495519 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 109/219] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:35 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:36.044703 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1b4dd3db-8c86-4c18-b243-bea5af6b50d1 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:36.047635 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1b4dd3db-8c86-4c18-b243-bea5af6b50d1 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:36.056694 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1b4dd3db-8c86-4c18-b243-bea5af6b50d1 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:36.057456 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1b4dd3db-8c86-4c18-b243-bea5af6b50d1 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:36.058396 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1b4dd3db-8c86-4c18-b243-bea5af6b50d1 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:36.058981 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1b4dd3db-8c86-4c18-b243-bea5af6b50d1 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:36.316652 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1b4dd3db-8c86-4c18-b243-bea5af6b50d1 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:36.326776 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1b4dd3db-8c86-4c18-b243-bea5af6b50d1 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1314 microversion: 2.1 time: 0.286269 May 10 16:49:36.328153 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 111/220] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:36 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:36.355784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-ec23a670-69bb-48af-9e18-8ce86636f078 req-3249fb79-cf7c-428d-95c0-3f7f7a5716d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717", "name": "network-vif-plugged", "status": "completed", "tag": "fd783ff0-31a4-4db4-a3b8-f7356a3f38bd"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:36.366546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-ec23a670-69bb-48af-9e18-8ce86636f078 req-3249fb79-cf7c-428d-95c0-3f7f7a5716d5 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:36.367410 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-ec23a670-69bb-48af-9e18-8ce86636f078 req-3249fb79-cf7c-428d-95c0-3f7f7a5716d5 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:36.388625 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-ec23a670-69bb-48af-9e18-8ce86636f078 req-3249fb79-cf7c-428d-95c0-3f7f7a5716d5 service nova] Creating event network-vif-plugged:fd783ff0-31a4-4db4-a3b8-f7356a3f38bd for instance b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 on hv-cinder-83588 May 10 16:49:36.394436 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-ec23a670-69bb-48af-9e18-8ce86636f078 req-3249fb79-cf7c-428d-95c0-3f7f7a5716d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044159 May 10 16:49:36.395319 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 110/221] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:36.511238 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ed8c981c-45e1-4ca5-bfce-eb755a8c9b6b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:36.511901 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ed8c981c-45e1-4ca5-bfce-eb755a8c9b6b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:36.522454 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ed8c981c-45e1-4ca5-bfce-eb755a8c9b6b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:36.523538 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ed8c981c-45e1-4ca5-bfce-eb755a8c9b6b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:36.524582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ed8c981c-45e1-4ca5-bfce-eb755a8c9b6b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:36.525183 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ed8c981c-45e1-4ca5-bfce-eb755a8c9b6b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:36.818718 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ed8c981c-45e1-4ca5-bfce-eb755a8c9b6b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:36.841041 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ed8c981c-45e1-4ca5-bfce-eb755a8c9b6b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.333715 May 10 16:49:36.841900 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 112/222] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:36 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:37.348044 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2a0a9cca-7d59-40df-93b1-6534050c4f6e tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:37.350088 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2a0a9cca-7d59-40df-93b1-6534050c4f6e tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:37.357136 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2a0a9cca-7d59-40df-93b1-6534050c4f6e tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:37.357851 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2a0a9cca-7d59-40df-93b1-6534050c4f6e tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:37.358657 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2a0a9cca-7d59-40df-93b1-6534050c4f6e tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:37.359224 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2a0a9cca-7d59-40df-93b1-6534050c4f6e tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:37.528822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2a0a9cca-7d59-40df-93b1-6534050c4f6e tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:37.537342 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2a0a9cca-7d59-40df-93b1-6534050c4f6e tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1314 microversion: 2.1 time: 0.194424 May 10 16:49:37.537736 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 111/223] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:37 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:37.861016 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9925f73e-c6bf-41ac-8a41-9ce2daf22352 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:37.861637 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9925f73e-c6bf-41ac-8a41-9ce2daf22352 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:37.869412 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9925f73e-c6bf-41ac-8a41-9ce2daf22352 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:37.869887 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9925f73e-c6bf-41ac-8a41-9ce2daf22352 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:37.870675 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9925f73e-c6bf-41ac-8a41-9ce2daf22352 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:37.871119 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9925f73e-c6bf-41ac-8a41-9ce2daf22352 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.023024 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9925f73e-c6bf-41ac-8a41-9ce2daf22352 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:38.041621 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9925f73e-c6bf-41ac-8a41-9ce2daf22352 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.184953 May 10 16:49:38.042313 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 113/224] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:37 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:38.191864 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-947173576", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:38.555056 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-83e18280-e966-426f-a814-d59a00529aa9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:38.555678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-83e18280-e966-426f-a814-d59a00529aa9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:38.562298 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-83e18280-e966-426f-a814-d59a00529aa9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.562773 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-83e18280-e966-426f-a814-d59a00529aa9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.563558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-83e18280-e966-426f-a814-d59a00529aa9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.563997 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-83e18280-e966-426f-a814-d59a00529aa9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.753948 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-83e18280-e966-426f-a814-d59a00529aa9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:38.764433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-83e18280-e966-426f-a814-d59a00529aa9 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1314 microversion: 2.1 time: 0.214152 May 10 16:49:38.765459 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 114/225] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:38 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:39.059952 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6a370f7a-10dc-4cee-9c9b-862c4e67220a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:39.060592 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6a370f7a-10dc-4cee-9c9b-862c4e67220a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:39.067014 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a370f7a-10dc-4cee-9c9b-862c4e67220a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:39.067468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a370f7a-10dc-4cee-9c9b-862c4e67220a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:39.068244 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a370f7a-10dc-4cee-9c9b-862c4e67220a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:39.068710 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a370f7a-10dc-4cee-9c9b-862c4e67220a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:39.230131 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6a370f7a-10dc-4cee-9c9b-862c4e67220a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:39.238000 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6a370f7a-10dc-4cee-9c9b-862c4e67220a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.182318 May 10 16:49:39.238585 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 115/226] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:39 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:39.788400 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-618fdfb1-f7ca-4721-bc44-c6597799a2e0 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:39.789201 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-618fdfb1-f7ca-4721-bc44-c6597799a2e0 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:39.796122 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-618fdfb1-f7ca-4721-bc44-c6597799a2e0 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:39.796689 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-618fdfb1-f7ca-4721-bc44-c6597799a2e0 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:39.797553 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-618fdfb1-f7ca-4721-bc44-c6597799a2e0 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:39.798128 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-618fdfb1-f7ca-4721-bc44-c6597799a2e0 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:39.944466 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-618fdfb1-f7ca-4721-bc44-c6597799a2e0 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:39.952204 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-618fdfb1-f7ca-4721-bc44-c6597799a2e0 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1498 microversion: 2.1 time: 0.172481 May 10 16:49:39.953022 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 116/227] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:39 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1498 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:40.258942 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f8f5be6f-1046-4995-8ab8-bb8ca18c94ce tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:40.260046 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f8f5be6f-1046-4995-8ab8-bb8ca18c94ce tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:40.267203 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f8f5be6f-1046-4995-8ab8-bb8ca18c94ce tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.267769 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f8f5be6f-1046-4995-8ab8-bb8ca18c94ce tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.268770 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f8f5be6f-1046-4995-8ab8-bb8ca18c94ce tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.269282 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f8f5be6f-1046-4995-8ab8-bb8ca18c94ce tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.421245 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f8f5be6f-1046-4995-8ab8-bb8ca18c94ce tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:40.432723 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f8f5be6f-1046-4995-8ab8-bb8ca18c94ce tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.180130 May 10 16:49:40.433613 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 117/228] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:40 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:40.490420 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-18e4bd7f-0c43-4f0d-9aa5-ee3d17c32cdc tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:40.491038 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-18e4bd7f-0c43-4f0d-9aa5-ee3d17c32cdc tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:40.497033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18e4bd7f-0c43-4f0d-9aa5-ee3d17c32cdc tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.497561 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18e4bd7f-0c43-4f0d-9aa5-ee3d17c32cdc tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.498428 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18e4bd7f-0c43-4f0d-9aa5-ee3d17c32cdc tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.498928 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18e4bd7f-0c43-4f0d-9aa5-ee3d17c32cdc tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.525869 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-18e4bd7f-0c43-4f0d-9aa5-ee3d17c32cdc tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Going to try to terminate instance {{(pid=134195) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:49:40.644113 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-18e4bd7f-0c43-4f0d-9aa5-ee3d17c32cdc tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 204 len: 0 microversion: 2.1 time: 0.156968 May 10 16:49:40.644972 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 118/229] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:49:40 2022] DELETE /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:49:40.656381 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2039ac3f-c6f3-4660-b5c6-af75edfca494 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:40.657667 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2039ac3f-c6f3-4660-b5c6-af75edfca494 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:40.669535 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2039ac3f-c6f3-4660-b5c6-af75edfca494 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.670214 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2039ac3f-c6f3-4660-b5c6-af75edfca494 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.671125 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2039ac3f-c6f3-4660-b5c6-af75edfca494 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.671634 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2039ac3f-c6f3-4660-b5c6-af75edfca494 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.814734 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2039ac3f-c6f3-4660-b5c6-af75edfca494 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:40.823566 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2039ac3f-c6f3-4660-b5c6-af75edfca494 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1504 microversion: 2.1 time: 0.173444 May 10 16:49:40.824224 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 119/230] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:40 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:41.450027 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-591d5c35-95b7-49ab-93b3-8e507d5a2580 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:41.450775 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-591d5c35-95b7-49ab-93b3-8e507d5a2580 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:41.457697 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-591d5c35-95b7-49ab-93b3-8e507d5a2580 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:41.458925 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-591d5c35-95b7-49ab-93b3-8e507d5a2580 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:41.459739 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-591d5c35-95b7-49ab-93b3-8e507d5a2580 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:41.460189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-591d5c35-95b7-49ab-93b3-8e507d5a2580 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:41.610977 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-591d5c35-95b7-49ab-93b3-8e507d5a2580 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:41.619045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-591d5c35-95b7-49ab-93b3-8e507d5a2580 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.172888 May 10 16:49:41.619643 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 120/231] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:41 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:41.841911 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-47cb88d5-a5c1-4409-ae2c-3cea70bc4222 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:41.842571 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-47cb88d5-a5c1-4409-ae2c-3cea70bc4222 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:41.849033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-47cb88d5-a5c1-4409-ae2c-3cea70bc4222 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:41.849472 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-47cb88d5-a5c1-4409-ae2c-3cea70bc4222 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:41.850242 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-47cb88d5-a5c1-4409-ae2c-3cea70bc4222 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:41.850668 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-47cb88d5-a5c1-4409-ae2c-3cea70bc4222 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.002749 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-47cb88d5-a5c1-4409-ae2c-3cea70bc4222 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:42.024049 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-47cb88d5-a5c1-4409-ae2c-3cea70bc4222 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1504 microversion: 2.1 time: 0.186686 May 10 16:49:42.024882 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 121/232] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:41 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:42.642752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6095d50b-2d99-46eb-b99b-157825568177 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:42.644017 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6095d50b-2d99-46eb-b99b-157825568177 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:42.653319 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6095d50b-2d99-46eb-b99b-157825568177 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.654146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6095d50b-2d99-46eb-b99b-157825568177 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.655027 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6095d50b-2d99-46eb-b99b-157825568177 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.655588 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6095d50b-2d99-46eb-b99b-157825568177 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.926081 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6095d50b-2d99-46eb-b99b-157825568177 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:42.940430 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6095d50b-2d99-46eb-b99b-157825568177 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.305390 May 10 16:49:42.944028 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 122/233] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:42 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:42.957588 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-7e675a70-53ff-4c67-964b-839221878596 req-1bbd6c10-c79d-441d-9961-4c1dd2f5d3bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717", "name": "network-vif-deleted", "tag": "fd783ff0-31a4-4db4-a3b8-f7356a3f38bd"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:42.970024 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-7e675a70-53ff-4c67-964b-839221878596 req-1bbd6c10-c79d-441d-9961-4c1dd2f5d3bd service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.970466 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-7e675a70-53ff-4c67-964b-839221878596 req-1bbd6c10-c79d-441d-9961-4c1dd2f5d3bd service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.985952 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-7e675a70-53ff-4c67-964b-839221878596 req-1bbd6c10-c79d-441d-9961-4c1dd2f5d3bd service nova] Creating event network-vif-deleted:fd783ff0-31a4-4db4-a3b8-f7356a3f38bd for instance b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 on hv-cinder-83588 May 10 16:49:42.992166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-7e675a70-53ff-4c67-964b-839221878596 req-1bbd6c10-c79d-441d-9961-4c1dd2f5d3bd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038224 May 10 16:49:42.992834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 123/234] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:49:43.044897 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:43.045849 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:43.054009 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.054765 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.055790 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.056239 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.092524 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.092980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.093459 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lazy-loading 'fault' on Instance uuid b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:49:43.141970 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd968e17fa36f403a923b7b42af28333d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:43.150717 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-12e73725-2409-4b84-8510-1d1213561885 tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 200 len: 1304 microversion: 2.1 time: 0.111828 May 10 16:49:43.151336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 124/235] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:43 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:43.958771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a2bc3866-55aa-430d-8f80-9eb0a1ac9ca7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:43.959685 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a2bc3866-55aa-430d-8f80-9eb0a1ac9ca7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:43.965723 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a2bc3866-55aa-430d-8f80-9eb0a1ac9ca7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.966272 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a2bc3866-55aa-430d-8f80-9eb0a1ac9ca7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.967138 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a2bc3866-55aa-430d-8f80-9eb0a1ac9ca7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.967733 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a2bc3866-55aa-430d-8f80-9eb0a1ac9ca7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:44.137066 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a2bc3866-55aa-430d-8f80-9eb0a1ac9ca7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:44.144819 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a2bc3866-55aa-430d-8f80-9eb0a1ac9ca7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.190537 May 10 16:49:44.145612 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 125/236] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:43 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:44.168856 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6bf8ff16-26d7-4c8e-9ba8-cb2adc216a3d tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:44.169655 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6bf8ff16-26d7-4c8e-9ba8-cb2adc216a3d tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] [instance: b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:44.175740 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6bf8ff16-26d7-4c8e-9ba8-cb2adc216a3d tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:44.177509 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6bf8ff16-26d7-4c8e-9ba8-cb2adc216a3d tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:44.178348 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6bf8ff16-26d7-4c8e-9ba8-cb2adc216a3d tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:44.178751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6bf8ff16-26d7-4c8e-9ba8-cb2adc216a3d tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:44.195542 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-6bf8ff16-26d7-4c8e-9ba8-cb2adc216a3d tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] HTTP exception thrown: Instance b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 could not be found. May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6bf8ff16-26d7-4c8e-9ba8-cb2adc216a3d tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Request method failure captured: May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 HTTP/1.1 May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepd95jhyC3Fpml9zHXP-z-xfHe8eqoYzk0o9mw-DSo5RIUWXEBim_3I2Vs69D_3cA3bxo886_sEGBQOo4ioUbP75GzTva1zZUC49_agN62ZVEoj0Lmn5CxJvkEb-LpZod_rLGLQ118bUY8ziJw0Nj9MneAoDRDkxkJ_i_EMSh_eLuOA May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: d968e17fa36f403a923b7b42af28333d May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-VolumesActionsTest-271225975 May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:49:44.197983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d968e17fa36f403a923b7b42af28333d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d968e17fa36f403a923b7b42af28333d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d968e17fa36f403a923b7b42af28333d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d968e17fa36f403a923b7b42af28333d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-VolumesActionsTest-271225975 May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: d968e17fa36f403a923b7b42af28333d May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-VolumesActionsTest-271225975 May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-VolumesActionsTest-271225975-project May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 0cc5e5dfa3bb45c6bf8c4fcfcaadceec May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-VolumesActionsTest-271225975-project May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 could not be found. May 10 16:49:44.199519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717'} May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 could not be found. May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:49:44.200645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 could not be found. May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 could not be found. May 10 16:49:44.202166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:49:44.203335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6bf8ff16-26d7-4c8e-9ba8-cb2adc216a3d tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] Returning 404 to user: Instance b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:49:44.203335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6bf8ff16-26d7-4c8e-9ba8-cb2adc216a3d tempest-VolumesActionsTest-271225975 tempest-VolumesActionsTest-271225975-project] 10.222.0.48 "GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717" status: 404 len: 111 microversion: 2.1 time: 0.035812 May 10 16:49:44.203335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 126/237] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:44 2022] GET /compute/v2.1/servers/b9a4cbd0-ccfc-44ff-9f3b-0aa24086d717 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 16:49:44.266880 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] validate_networks() for None {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:49:44.643430 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:49:44.643841 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:49:44.644652 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:49:44.645113 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:49:44.646058 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:49:44.657605 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:44.658576 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:44.659614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:44.660225 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:44.681453 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Getting quotas for project 9cba4b165ecb44ef8c7018958198eb36. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:49:44.686202 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Getting quotas for user 8de59690354e4f00b10847b64c1166ab and project 9cba4b165ecb44ef8c7018958198eb36. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:49:44.705070 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:49:44.707731 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:49:44.777367 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-5c9a129f-cdc0-466a-b07f-5426640959a6 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.591010 May 10 16:49:44.778107 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 112/238] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:49:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 6593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:49:44.788859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-43470ae0-0823-4644-b2f5-fbad957ef589 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:44.789487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-43470ae0-0823-4644-b2f5-fbad957ef589 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:44.875374 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-43470ae0-0823-4644-b2f5-fbad957ef589 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:44.885826 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-43470ae0-0823-4644-b2f5-fbad957ef589 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1214 microversion: 2.1 time: 0.101449 May 10 16:49:44.901208 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 127/239] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:44 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:45.167702 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2e275d2f-0643-45c4-896d-842a4479a3b1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:45.167702 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2e275d2f-0643-45c4-896d-842a4479a3b1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:45.175293 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2e275d2f-0643-45c4-896d-842a4479a3b1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:45.175764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2e275d2f-0643-45c4-896d-842a4479a3b1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:45.181306 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2e275d2f-0643-45c4-896d-842a4479a3b1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:45.181535 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2e275d2f-0643-45c4-896d-842a4479a3b1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:45.425632 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2e275d2f-0643-45c4-896d-842a4479a3b1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:45.437902 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2e275d2f-0643-45c4-896d-842a4479a3b1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.279117 May 10 16:49:45.438593 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 113/240] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:45 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:45.904885 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2776e677-80ec-4d9b-9bd7-27bfded97cba tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:45.905661 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2776e677-80ec-4d9b-9bd7-27bfded97cba tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:45.915119 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2776e677-80ec-4d9b-9bd7-27bfded97cba tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:45.915773 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2776e677-80ec-4d9b-9bd7-27bfded97cba tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:45.916637 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2776e677-80ec-4d9b-9bd7-27bfded97cba tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:45.917084 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2776e677-80ec-4d9b-9bd7-27bfded97cba tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:45.987611 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2776e677-80ec-4d9b-9bd7-27bfded97cba tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:45.995324 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2776e677-80ec-4d9b-9bd7-27bfded97cba tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1210 microversion: 2.1 time: 0.094643 May 10 16:49:45.995917 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 128/241] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:45 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:46.455105 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-028f47b9-3376-44b0-baa7-efd7b09d84a4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:46.455721 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-028f47b9-3376-44b0-baa7-efd7b09d84a4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:46.462485 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-028f47b9-3376-44b0-baa7-efd7b09d84a4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:46.462939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-028f47b9-3376-44b0-baa7-efd7b09d84a4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:46.463725 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-028f47b9-3376-44b0-baa7-efd7b09d84a4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:46.464170 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-028f47b9-3376-44b0-baa7-efd7b09d84a4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:46.615117 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-028f47b9-3376-44b0-baa7-efd7b09d84a4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:46.622934 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-028f47b9-3376-44b0-baa7-efd7b09d84a4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.171700 May 10 16:49:46.623638 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 114/242] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:46 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:47.013192 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-cd896794-67df-4ccd-86cb-1497edc0c58a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:47.013854 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-cd896794-67df-4ccd-86cb-1497edc0c58a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:47.021735 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cd896794-67df-4ccd-86cb-1497edc0c58a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:47.022200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cd896794-67df-4ccd-86cb-1497edc0c58a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:47.022993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cd896794-67df-4ccd-86cb-1497edc0c58a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:47.023438 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cd896794-67df-4ccd-86cb-1497edc0c58a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:47.107276 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cd896794-67df-4ccd-86cb-1497edc0c58a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:47.115118 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-cd896794-67df-4ccd-86cb-1497edc0c58a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1210 microversion: 2.1 time: 0.105769 May 10 16:49:47.115731 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 129/243] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:47 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:47.644710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-18915c04-5f37-499b-9b39-baabb6618f65 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:47.644710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-18915c04-5f37-499b-9b39-baabb6618f65 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:47.651010 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18915c04-5f37-499b-9b39-baabb6618f65 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:47.651465 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18915c04-5f37-499b-9b39-baabb6618f65 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:47.652254 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18915c04-5f37-499b-9b39-baabb6618f65 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:47.652708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18915c04-5f37-499b-9b39-baabb6618f65 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:47.796310 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-18915c04-5f37-499b-9b39-baabb6618f65 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:47.806313 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-18915c04-5f37-499b-9b39-baabb6618f65 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.168064 May 10 16:49:47.806917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 115/244] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:47 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:48.133066 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-702c55f4-2432-42bf-aebd-e276665888c0 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:48.133862 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-702c55f4-2432-42bf-aebd-e276665888c0 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:48.140209 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-702c55f4-2432-42bf-aebd-e276665888c0 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:48.140763 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-702c55f4-2432-42bf-aebd-e276665888c0 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:48.141547 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-702c55f4-2432-42bf-aebd-e276665888c0 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:48.141990 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-702c55f4-2432-42bf-aebd-e276665888c0 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:48.206891 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-702c55f4-2432-42bf-aebd-e276665888c0 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:48.215174 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-702c55f4-2432-42bf-aebd-e276665888c0 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1210 microversion: 2.1 time: 0.086725 May 10 16:49:48.215981 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 130/245] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:48 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:48.824883 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8c962ef1-8ce3-4490-a122-9ec10210d23b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:48.825425 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8c962ef1-8ce3-4490-a122-9ec10210d23b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:48.831654 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8c962ef1-8ce3-4490-a122-9ec10210d23b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:48.832129 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8c962ef1-8ce3-4490-a122-9ec10210d23b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:48.832969 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8c962ef1-8ce3-4490-a122-9ec10210d23b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:48.833539 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8c962ef1-8ce3-4490-a122-9ec10210d23b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:48.972034 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8c962ef1-8ce3-4490-a122-9ec10210d23b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:48.982893 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8c962ef1-8ce3-4490-a122-9ec10210d23b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1522 microversion: 2.1 time: 0.161748 May 10 16:49:48.983805 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 116/246] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:48 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:49.232559 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c0bed264-fe96-459f-8a45-f5ea6f8683a9 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:49.233157 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c0bed264-fe96-459f-8a45-f5ea6f8683a9 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:49.240236 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c0bed264-fe96-459f-8a45-f5ea6f8683a9 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:49.240711 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c0bed264-fe96-459f-8a45-f5ea6f8683a9 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:49.241491 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c0bed264-fe96-459f-8a45-f5ea6f8683a9 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:49.241928 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c0bed264-fe96-459f-8a45-f5ea6f8683a9 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:49.311754 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c0bed264-fe96-459f-8a45-f5ea6f8683a9 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:49.319291 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c0bed264-fe96-459f-8a45-f5ea6f8683a9 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1266 microversion: 2.1 time: 0.090486 May 10 16:49:49.320155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 131/247] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:49 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:50.005375 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cd10a4ca-7f6b-4f58-bb32-e7dc83007fca tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:50.006789 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cd10a4ca-7f6b-4f58-bb32-e7dc83007fca tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:50.020848 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd10a4ca-7f6b-4f58-bb32-e7dc83007fca tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:50.021987 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd10a4ca-7f6b-4f58-bb32-e7dc83007fca tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:50.022800 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd10a4ca-7f6b-4f58-bb32-e7dc83007fca tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:50.023617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd10a4ca-7f6b-4f58-bb32-e7dc83007fca tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:50.240359 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cd10a4ca-7f6b-4f58-bb32-e7dc83007fca tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:50.245221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cd10a4ca-7f6b-4f58-bb32-e7dc83007fca tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1502 microversion: 2.1 time: 0.246137 May 10 16:49:50.259959 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 117/248] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:49 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:50.265692 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-32448a00-9049-4490-833b-12768691d439 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:50.266907 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-32448a00-9049-4490-833b-12768691d439 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:50.277296 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-32448a00-9049-4490-833b-12768691d439 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:50.278053 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-32448a00-9049-4490-833b-12768691d439 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:50.279357 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-32448a00-9049-4490-833b-12768691d439 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:50.280092 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-32448a00-9049-4490-833b-12768691d439 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:50.341053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-47c165b6-b790-4576-b3c2-ae7cabcb89d5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:50.341857 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-47c165b6-b790-4576-b3c2-ae7cabcb89d5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:50.348668 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-47c165b6-b790-4576-b3c2-ae7cabcb89d5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:50.349119 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-47c165b6-b790-4576-b3c2-ae7cabcb89d5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:50.350145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-47c165b6-b790-4576-b3c2-ae7cabcb89d5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:50.350731 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-47c165b6-b790-4576-b3c2-ae7cabcb89d5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:50.427160 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-47c165b6-b790-4576-b3c2-ae7cabcb89d5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:50.435261 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-47c165b6-b790-4576-b3c2-ae7cabcb89d5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1272 microversion: 2.1 time: 0.099433 May 10 16:49:50.436187 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 118/249] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:50 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:50.453765 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-32448a00-9049-4490-833b-12768691d439 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:50.465774 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-32448a00-9049-4490-833b-12768691d439 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1517 microversion: 2.1 time: 0.202937 May 10 16:49:50.466604 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 132/250] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:50 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:51.452521 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ca89549b-b4c5-493f-8efe-1742d8e1dd8a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:51.453158 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ca89549b-b4c5-493f-8efe-1742d8e1dd8a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:51.459672 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ca89549b-b4c5-493f-8efe-1742d8e1dd8a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:51.460422 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ca89549b-b4c5-493f-8efe-1742d8e1dd8a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:51.461349 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ca89549b-b4c5-493f-8efe-1742d8e1dd8a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:51.461853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ca89549b-b4c5-493f-8efe-1742d8e1dd8a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:51.618486 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ca89549b-b4c5-493f-8efe-1742d8e1dd8a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:51.626006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ca89549b-b4c5-493f-8efe-1742d8e1dd8a tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1314 microversion: 2.1 time: 0.177468 May 10 16:49:51.626584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 119/251] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:51 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:52.245282 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-deb669bb-062c-4b7f-a7fd-dc0c52a2a432 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:52.245883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-deb669bb-062c-4b7f-a7fd-dc0c52a2a432 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:52.251842 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-deb669bb-062c-4b7f-a7fd-dc0c52a2a432 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:52.252303 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-deb669bb-062c-4b7f-a7fd-dc0c52a2a432 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:52.253130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-deb669bb-062c-4b7f-a7fd-dc0c52a2a432 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:52.253559 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-deb669bb-062c-4b7f-a7fd-dc0c52a2a432 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:52.280461 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-deb669bb-062c-4b7f-a7fd-dc0c52a2a432 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/ips" status: 200 len: 146 microversion: 2.1 time: 0.039127 May 10 16:49:52.281066 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 133/252] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 10 16:49:52 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:52.643743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c22737be-a476-40c8-9c0f-c2c67235c32d tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:52.644415 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c22737be-a476-40c8-9c0f-c2c67235c32d tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:52.650413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c22737be-a476-40c8-9c0f-c2c67235c32d tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:52.650885 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c22737be-a476-40c8-9c0f-c2c67235c32d tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:52.651650 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c22737be-a476-40c8-9c0f-c2c67235c32d tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:52.652080 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c22737be-a476-40c8-9c0f-c2c67235c32d tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:52.799513 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c22737be-a476-40c8-9c0f-c2c67235c32d tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:52.807957 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c22737be-a476-40c8-9c0f-c2c67235c32d tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1314 microversion: 2.1 time: 0.168473 May 10 16:49:52.808578 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 120/253] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:52 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:53.760200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-28a2f591-c77e-4460-9c59-e7d2ec9b738c req-a5332817-293f-4ac4-96df-b48c4346de8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5d4dee2-fea3-4713-a183-2402a1c2e66b", "tag": "b2c46bf8-2aae-4564-a113-01d39287e407"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:53.770002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-28a2f591-c77e-4460-9c59-e7d2ec9b738c req-a5332817-293f-4ac4-96df-b48c4346de8d service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:53.771297 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-28a2f591-c77e-4460-9c59-e7d2ec9b738c req-a5332817-293f-4ac4-96df-b48c4346de8d service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:53.788930 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-28a2f591-c77e-4460-9c59-e7d2ec9b738c req-a5332817-293f-4ac4-96df-b48c4346de8d service nova] Creating event network-changed:b2c46bf8-2aae-4564-a113-01d39287e407 for instance b5d4dee2-fea3-4713-a183-2402a1c2e66b on hv-cinder-83588 May 10 16:49:53.796071 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-28a2f591-c77e-4460-9c59-e7d2ec9b738c req-a5332817-293f-4ac4-96df-b48c4346de8d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039750 May 10 16:49:53.796836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 134/254] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:53.825081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a9c8ce56-26af-4dd2-b30c-0d876bff77f5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:53.825793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a9c8ce56-26af-4dd2-b30c-0d876bff77f5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:53.833510 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9c8ce56-26af-4dd2-b30c-0d876bff77f5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:53.836185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9c8ce56-26af-4dd2-b30c-0d876bff77f5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:53.836185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9c8ce56-26af-4dd2-b30c-0d876bff77f5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:53.836185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9c8ce56-26af-4dd2-b30c-0d876bff77f5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:53.969704 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a9c8ce56-26af-4dd2-b30c-0d876bff77f5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:53.976969 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a9c8ce56-26af-4dd2-b30c-0d876bff77f5 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1314 microversion: 2.1 time: 0.155793 May 10 16:49:53.977751 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 121/255] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:53 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:54.995879 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f1ea8eb3-3589-44fb-93f6-5c817d7987bb tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:54.996769 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f1ea8eb3-3589-44fb-93f6-5c817d7987bb tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:55.003301 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f1ea8eb3-3589-44fb-93f6-5c817d7987bb tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:55.003832 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f1ea8eb3-3589-44fb-93f6-5c817d7987bb tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:55.004980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f1ea8eb3-3589-44fb-93f6-5c817d7987bb tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:55.005524 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f1ea8eb3-3589-44fb-93f6-5c817d7987bb tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:55.167652 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f1ea8eb3-3589-44fb-93f6-5c817d7987bb tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:55.177645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f1ea8eb3-3589-44fb-93f6-5c817d7987bb tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1314 microversion: 2.1 time: 0.184161 May 10 16:49:55.178542 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 135/256] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:54 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:55.221960 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-af2af34e-ab85-4475-875d-b6527ba2f5ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:55.224194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-af2af34e-ab85-4475-875d-b6527ba2f5ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:55.230579 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-af2af34e-ab85-4475-875d-b6527ba2f5ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:55.231113 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-af2af34e-ab85-4475-875d-b6527ba2f5ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:55.231975 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-af2af34e-ab85-4475-875d-b6527ba2f5ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:55.232660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-af2af34e-ab85-4475-875d-b6527ba2f5ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:55.258669 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-af2af34e-ab85-4475-875d-b6527ba2f5ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lazy-loading 'flavor' on Instance uuid c82b30ce-5490-4df6-8d9e-12bf93154ae8 {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:49:55.376740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-af2af34e-ab85-4475-875d-b6527ba2f5ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8/action" status: 200 len: 32 microversion: 2.1 time: 0.158840 May 10 16:49:55.377960 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 122/257] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:49:55 2022] POST /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 16:49:55.389965 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-05f24f9c-1461-42ae-8be6-e3102d7510c0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:55.391124 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-05f24f9c-1461-42ae-8be6-e3102d7510c0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:55.400945 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-05f24f9c-1461-42ae-8be6-e3102d7510c0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:55.401472 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-05f24f9c-1461-42ae-8be6-e3102d7510c0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:55.402309 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-05f24f9c-1461-42ae-8be6-e3102d7510c0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:55.402900 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-05f24f9c-1461-42ae-8be6-e3102d7510c0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:55.706994 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-05f24f9c-1461-42ae-8be6-e3102d7510c0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:55.720554 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-05f24f9c-1461-42ae-8be6-e3102d7510c0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.335786 May 10 16:49:55.721563 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 136/258] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:55 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:56.195602 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6b51f334-bfcd-4941-9d43-4674feca94cc tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:56.196193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6b51f334-bfcd-4941-9d43-4674feca94cc tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:56.202641 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6b51f334-bfcd-4941-9d43-4674feca94cc tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:56.203323 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6b51f334-bfcd-4941-9d43-4674feca94cc tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:56.204096 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6b51f334-bfcd-4941-9d43-4674feca94cc tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:56.204749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6b51f334-bfcd-4941-9d43-4674feca94cc tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:56.369455 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6b51f334-bfcd-4941-9d43-4674feca94cc tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:56.377761 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6b51f334-bfcd-4941-9d43-4674feca94cc tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1314 microversion: 2.1 time: 0.187296 May 10 16:49:56.378616 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 123/259] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:56 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:56.720775 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f55585bf-af90-40bf-a135-f4e9252b7483 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80661985-c4ff-412d-a2af-b34bba019b0e"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:56.721846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f55585bf-af90-40bf-a135-f4e9252b7483 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:56.728536 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f55585bf-af90-40bf-a135-f4e9252b7483 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:56.728989 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f55585bf-af90-40bf-a135-f4e9252b7483 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:56.729770 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f55585bf-af90-40bf-a135-f4e9252b7483 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:56.730208 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f55585bf-af90-40bf-a135-f4e9252b7483 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:56.739447 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a52085f5-5a3e-4b12-acdf-1f9ca150c9bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:56.740696 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a52085f5-5a3e-4b12-acdf-1f9ca150c9bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:56.749477 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a52085f5-5a3e-4b12-acdf-1f9ca150c9bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:56.749930 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a52085f5-5a3e-4b12-acdf-1f9ca150c9bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:56.750770 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a52085f5-5a3e-4b12-acdf-1f9ca150c9bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:56.751425 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a52085f5-5a3e-4b12-acdf-1f9ca150c9bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:56.938784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a52085f5-5a3e-4b12-acdf-1f9ca150c9bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:56.962400 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a52085f5-5a3e-4b12-acdf-1f9ca150c9bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.227392 May 10 16:49:56.963535 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 124/260] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:56 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:57.387458 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f55585bf-af90-40bf-a135-f4e9252b7483 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670121 May 10 16:49:57.388452 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 137/261] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:49:56 2022] POST /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:57.399949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-18adc14c-ed1e-4608-b6f0-e54fb09ef232 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:57.401256 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-18adc14c-ed1e-4608-b6f0-e54fb09ef232 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:57.420416 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18adc14c-ed1e-4608-b6f0-e54fb09ef232 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:57.421101 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18adc14c-ed1e-4608-b6f0-e54fb09ef232 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:57.422055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18adc14c-ed1e-4608-b6f0-e54fb09ef232 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:57.422855 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18adc14c-ed1e-4608-b6f0-e54fb09ef232 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:57.719672 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-18adc14c-ed1e-4608-b6f0-e54fb09ef232 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:57.728762 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-18adc14c-ed1e-4608-b6f0-e54fb09ef232 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1314 microversion: 2.1 time: 0.334735 May 10 16:49:57.730888 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 125/262] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:57 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:57.983614 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-11e04fc0-8721-42ca-8b23-df79cf990f7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:57.985569 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-11e04fc0-8721-42ca-8b23-df79cf990f7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:57.995138 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-11e04fc0-8721-42ca-8b23-df79cf990f7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:57.996630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-11e04fc0-8721-42ca-8b23-df79cf990f7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:57.997706 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-11e04fc0-8721-42ca-8b23-df79cf990f7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:57.998606 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-11e04fc0-8721-42ca-8b23-df79cf990f7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:58.158393 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-11e04fc0-8721-42ca-8b23-df79cf990f7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:58.168956 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-11e04fc0-8721-42ca-8b23-df79cf990f7d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.191180 May 10 16:49:58.169547 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 138/263] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:57 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:58.750223 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9b75d286-c88f-4dec-9d8c-cfb708437b90 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:58.751443 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9b75d286-c88f-4dec-9d8c-cfb708437b90 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:58.761499 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9b75d286-c88f-4dec-9d8c-cfb708437b90 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:58.763000 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9b75d286-c88f-4dec-9d8c-cfb708437b90 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:58.763818 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9b75d286-c88f-4dec-9d8c-cfb708437b90 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:58.766983 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9b75d286-c88f-4dec-9d8c-cfb708437b90 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:59.025299 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9b75d286-c88f-4dec-9d8c-cfb708437b90 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:59.041284 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9b75d286-c88f-4dec-9d8c-cfb708437b90 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1314 microversion: 2.1 time: 0.295560 May 10 16:49:59.049629 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 126/264] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:58 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:59.188441 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-bc3846bc-f240-4275-8cc2-09be7653fd5f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:59.189850 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-bc3846bc-f240-4275-8cc2-09be7653fd5f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:59.199702 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bc3846bc-f240-4275-8cc2-09be7653fd5f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:59.200418 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bc3846bc-f240-4275-8cc2-09be7653fd5f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:59.201578 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bc3846bc-f240-4275-8cc2-09be7653fd5f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:59.202297 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bc3846bc-f240-4275-8cc2-09be7653fd5f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:59.389642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bc3846bc-f240-4275-8cc2-09be7653fd5f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:59.402977 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-bc3846bc-f240-4275-8cc2-09be7653fd5f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.218781 May 10 16:49:59.415273 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 139/265] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:49:59 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:59.545688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-7ca4f143-788a-43a8-a432-1b3ba839383d req-4270023a-e3db-4179-a4be-4e064c2920dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d4dee2-fea3-4713-a183-2402a1c2e66b", "name": "network-vif-plugged", "status": "completed", "tag": "b2c46bf8-2aae-4564-a113-01d39287e407"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:59.579919 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-7ca4f143-788a-43a8-a432-1b3ba839383d req-4270023a-e3db-4179-a4be-4e064c2920dd service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:59.580520 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-7ca4f143-788a-43a8-a432-1b3ba839383d req-4270023a-e3db-4179-a4be-4e064c2920dd service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:59.611762 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-7ca4f143-788a-43a8-a432-1b3ba839383d req-4270023a-e3db-4179-a4be-4e064c2920dd service nova] Creating event network-vif-plugged:b2c46bf8-2aae-4564-a113-01d39287e407 for instance b5d4dee2-fea3-4713-a183-2402a1c2e66b on hv-cinder-83588 May 10 16:49:59.649057 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-7ca4f143-788a-43a8-a432-1b3ba839383d req-4270023a-e3db-4179-a4be-4e064c2920dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124343 May 10 16:49:59.655275 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 127/266] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:00.062607 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d6689826-b397-4379-ae0c-6f695695e823 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:00.063370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d6689826-b397-4379-ae0c-6f695695e823 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:00.073175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d6689826-b397-4379-ae0c-6f695695e823 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:00.076230 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d6689826-b397-4379-ae0c-6f695695e823 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:00.083529 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d6689826-b397-4379-ae0c-6f695695e823 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:00.084107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d6689826-b397-4379-ae0c-6f695695e823 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:00.415306 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d6689826-b397-4379-ae0c-6f695695e823 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:00.425545 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3188b5b3-0fc9-4e44-b228-7956150ac517 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:00.427908 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3188b5b3-0fc9-4e44-b228-7956150ac517 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:00.445753 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d6689826-b397-4379-ae0c-6f695695e823 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1314 microversion: 2.1 time: 0.386698 May 10 16:50:00.446849 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 140/267] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:00 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:00.447796 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3188b5b3-0fc9-4e44-b228-7956150ac517 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:00.448561 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3188b5b3-0fc9-4e44-b228-7956150ac517 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:00.449610 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3188b5b3-0fc9-4e44-b228-7956150ac517 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:00.450233 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3188b5b3-0fc9-4e44-b228-7956150ac517 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:00.815938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3188b5b3-0fc9-4e44-b228-7956150ac517 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:00.833173 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3188b5b3-0fc9-4e44-b228-7956150ac517 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.414163 May 10 16:50:00.837349 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 128/268] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:00 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:01.466323 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8f391620-b445-4362-893c-a0324ee0c8d2 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:01.468037 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8f391620-b445-4362-893c-a0324ee0c8d2 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:01.482803 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8f391620-b445-4362-893c-a0324ee0c8d2 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:01.483667 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8f391620-b445-4362-893c-a0324ee0c8d2 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:01.484937 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8f391620-b445-4362-893c-a0324ee0c8d2 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:01.487326 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8f391620-b445-4362-893c-a0324ee0c8d2 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:01.743466 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8f391620-b445-4362-893c-a0324ee0c8d2 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:01.756986 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8f391620-b445-4362-893c-a0324ee0c8d2 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1314 microversion: 2.1 time: 0.296074 May 10 16:50:01.773028 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 141/269] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:01 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:01.859872 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5b2ab582-4e10-4654-8f80-ea75d661eeb7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:01.861292 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5b2ab582-4e10-4654-8f80-ea75d661eeb7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:01.876317 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5b2ab582-4e10-4654-8f80-ea75d661eeb7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:01.880554 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5b2ab582-4e10-4654-8f80-ea75d661eeb7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:01.882391 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5b2ab582-4e10-4654-8f80-ea75d661eeb7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:01.884027 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5b2ab582-4e10-4654-8f80-ea75d661eeb7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:02.174985 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-5b2ab582-4e10-4654-8f80-ea75d661eeb7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:02.184437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-5b2ab582-4e10-4654-8f80-ea75d661eeb7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.332921 May 10 16:50:02.185348 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 129/270] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:01 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:02.776051 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-661b3c59-9680-4bc6-841b-0160a6dad286 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:02.776733 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-661b3c59-9680-4bc6-841b-0160a6dad286 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:02.786379 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-661b3c59-9680-4bc6-841b-0160a6dad286 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:02.787351 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-661b3c59-9680-4bc6-841b-0160a6dad286 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:02.788473 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-661b3c59-9680-4bc6-841b-0160a6dad286 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:02.789171 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-661b3c59-9680-4bc6-841b-0160a6dad286 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:03.017235 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-661b3c59-9680-4bc6-841b-0160a6dad286 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:03.032669 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-661b3c59-9680-4bc6-841b-0160a6dad286 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1464 microversion: 2.1 time: 0.260719 May 10 16:50:03.036008 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 142/271] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:02 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:03.095006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ff033dd8-b8c1-43ed-a9ce-f4aab260fb0e tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:03.095578 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ff033dd8-b8c1-43ed-a9ce-f4aab260fb0e tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:03.103371 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff033dd8-b8c1-43ed-a9ce-f4aab260fb0e tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:03.104054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff033dd8-b8c1-43ed-a9ce-f4aab260fb0e tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:03.104884 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff033dd8-b8c1-43ed-a9ce-f4aab260fb0e tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:03.105485 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff033dd8-b8c1-43ed-a9ce-f4aab260fb0e tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:03.153416 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ff033dd8-b8c1-43ed-a9ce-f4aab260fb0e tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:50:03.205790 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-73049939-17f6-452d-8f40-eac8a8ae07a9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:03.207404 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-73049939-17f6-452d-8f40-eac8a8ae07a9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:03.224085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73049939-17f6-452d-8f40-eac8a8ae07a9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:03.224716 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73049939-17f6-452d-8f40-eac8a8ae07a9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:03.225593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73049939-17f6-452d-8f40-eac8a8ae07a9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:03.226407 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73049939-17f6-452d-8f40-eac8a8ae07a9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:03.302217 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ff033dd8-b8c1-43ed-a9ce-f4aab260fb0e tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 204 len: 0 microversion: 2.1 time: 0.209579 May 10 16:50:03.308537 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 130/272] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:50:03 2022] DELETE /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:50:03.314635 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-75ed9018-1f48-4c6c-ab31-cc5cddff44da tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:03.315677 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-75ed9018-1f48-4c6c-ab31-cc5cddff44da tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:03.325190 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-75ed9018-1f48-4c6c-ab31-cc5cddff44da tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:03.326025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-75ed9018-1f48-4c6c-ab31-cc5cddff44da tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:03.326992 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-75ed9018-1f48-4c6c-ab31-cc5cddff44da tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:03.327609 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-75ed9018-1f48-4c6c-ab31-cc5cddff44da tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:03.460359 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-73049939-17f6-452d-8f40-eac8a8ae07a9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:03.470838 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-73049939-17f6-452d-8f40-eac8a8ae07a9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.270594 May 10 16:50:03.474307 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 143/273] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:03 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:03.541794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-75ed9018-1f48-4c6c-ab31-cc5cddff44da tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:03.550036 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-75ed9018-1f48-4c6c-ab31-cc5cddff44da tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1470 microversion: 2.1 time: 0.239864 May 10 16:50:03.561764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 131/274] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:03 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1470 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:04.490232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7d1eedfe-cb20-4f6a-9bc5-0fd3a19621fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:04.491335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7d1eedfe-cb20-4f6a-9bc5-0fd3a19621fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:04.497893 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7d1eedfe-cb20-4f6a-9bc5-0fd3a19621fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:04.498375 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7d1eedfe-cb20-4f6a-9bc5-0fd3a19621fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:04.499149 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7d1eedfe-cb20-4f6a-9bc5-0fd3a19621fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:04.499588 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7d1eedfe-cb20-4f6a-9bc5-0fd3a19621fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:04.569920 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2cdc8e99-8a06-4834-aa42-aac76171df10 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:04.571039 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2cdc8e99-8a06-4834-aa42-aac76171df10 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:04.578258 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2cdc8e99-8a06-4834-aa42-aac76171df10 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:04.578715 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2cdc8e99-8a06-4834-aa42-aac76171df10 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:04.579504 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2cdc8e99-8a06-4834-aa42-aac76171df10 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:04.580198 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2cdc8e99-8a06-4834-aa42-aac76171df10 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:04.653995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7d1eedfe-cb20-4f6a-9bc5-0fd3a19621fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:04.662767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7d1eedfe-cb20-4f6a-9bc5-0fd3a19621fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.178256 May 10 16:50:04.663372 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 144/275] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:04 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:04.721399 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2cdc8e99-8a06-4834-aa42-aac76171df10 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:04.729945 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2cdc8e99-8a06-4834-aa42-aac76171df10 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1470 microversion: 2.1 time: 0.165414 May 10 16:50:04.730544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 132/276] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:04 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:05.681121 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e8740008-2edb-46ec-8618-250576cedfc3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:05.681982 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e8740008-2edb-46ec-8618-250576cedfc3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:05.690476 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8740008-2edb-46ec-8618-250576cedfc3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:05.690930 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8740008-2edb-46ec-8618-250576cedfc3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:05.692326 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8740008-2edb-46ec-8618-250576cedfc3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:05.692786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8740008-2edb-46ec-8618-250576cedfc3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:05.748343 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2e034633-b3c3-4960-83ee-904a7b192f12 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:05.748953 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2e034633-b3c3-4960-83ee-904a7b192f12 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:05.755307 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2e034633-b3c3-4960-83ee-904a7b192f12 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:05.755772 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2e034633-b3c3-4960-83ee-904a7b192f12 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:05.756589 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2e034633-b3c3-4960-83ee-904a7b192f12 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:05.757023 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2e034633-b3c3-4960-83ee-904a7b192f12 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:05.826818 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e8740008-2edb-46ec-8618-250576cedfc3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:05.835169 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e8740008-2edb-46ec-8618-250576cedfc3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.159323 May 10 16:50:05.835765 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 145/277] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:05 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:05.888398 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2e034633-b3c3-4960-83ee-904a7b192f12 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:05.896367 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2e034633-b3c3-4960-83ee-904a7b192f12 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1470 microversion: 2.1 time: 0.151862 May 10 16:50:05.896955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 133/278] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:05 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:06.852287 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-aed1e31a-322c-402c-ab1e-b80d1bb2d35b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:06.852807 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-aed1e31a-322c-402c-ab1e-b80d1bb2d35b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:06.859332 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aed1e31a-322c-402c-ab1e-b80d1bb2d35b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:06.859780 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aed1e31a-322c-402c-ab1e-b80d1bb2d35b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:06.860584 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aed1e31a-322c-402c-ab1e-b80d1bb2d35b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:06.861027 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aed1e31a-322c-402c-ab1e-b80d1bb2d35b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:06.914875 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0092d0ad-d070-46fd-8be5-01936a819063 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:06.915599 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0092d0ad-d070-46fd-8be5-01936a819063 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:06.921727 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0092d0ad-d070-46fd-8be5-01936a819063 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:06.922178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0092d0ad-d070-46fd-8be5-01936a819063 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:06.922937 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0092d0ad-d070-46fd-8be5-01936a819063 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:06.923369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0092d0ad-d070-46fd-8be5-01936a819063 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:07.006642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-aed1e31a-322c-402c-ab1e-b80d1bb2d35b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:07.014358 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-aed1e31a-322c-402c-ab1e-b80d1bb2d35b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.165965 May 10 16:50:07.014947 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 146/279] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:06 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:07.063225 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0092d0ad-d070-46fd-8be5-01936a819063 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:07.072925 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0092d0ad-d070-46fd-8be5-01936a819063 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1470 microversion: 2.1 time: 0.162166 May 10 16:50:07.073935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 134/280] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:06 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:08.033501 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-85100f42-8460-426c-8bb0-095394292b60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:08.035595 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-85100f42-8460-426c-8bb0-095394292b60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:08.048125 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-85100f42-8460-426c-8bb0-095394292b60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:08.049658 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-85100f42-8460-426c-8bb0-095394292b60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:08.053056 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-85100f42-8460-426c-8bb0-095394292b60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:08.053853 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-85100f42-8460-426c-8bb0-095394292b60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:08.091597 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b4dac258-f207-49f7-a188-16315c65ada3 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:08.092888 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b4dac258-f207-49f7-a188-16315c65ada3 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:08.103395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b4dac258-f207-49f7-a188-16315c65ada3 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:08.105068 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b4dac258-f207-49f7-a188-16315c65ada3 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:08.106380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b4dac258-f207-49f7-a188-16315c65ada3 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:08.107193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b4dac258-f207-49f7-a188-16315c65ada3 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:08.349557 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b4dac258-f207-49f7-a188-16315c65ada3 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:08.366828 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b4dac258-f207-49f7-a188-16315c65ada3 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1470 microversion: 2.1 time: 0.279914 May 10 16:50:08.378082 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 135/281] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:08 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:08.471247 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-85100f42-8460-426c-8bb0-095394292b60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:08.491667 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-85100f42-8460-426c-8bb0-095394292b60 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.452209 May 10 16:50:08.491667 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 147/282] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:08 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:08.498075 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c3443a8e-f8ad-4d0e-8a4f-9c58ab077a6b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:08.510882 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c3443a8e-f8ad-4d0e-8a4f-9c58ab077a6b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:08.511346 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c3443a8e-f8ad-4d0e-8a4f-9c58ab077a6b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:08.633369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c3443a8e-f8ad-4d0e-8a4f-9c58ab077a6b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Going to try to stop instance {{(pid=134194) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 16:50:08.710954 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c3443a8e-f8ad-4d0e-8a4f-9c58ab077a6b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/action" status: 202 len: 0 microversion: 2.1 time: 0.217789 May 10 16:50:08.712319 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 136/283] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:50:08 2022] POST /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:50:08.728112 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-51684dff-9de0-47fc-9790-070d3ab57825 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:08.729322 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-51684dff-9de0-47fc-9790-070d3ab57825 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:08.737755 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51684dff-9de0-47fc-9790-070d3ab57825 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:08.738703 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51684dff-9de0-47fc-9790-070d3ab57825 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:08.739896 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51684dff-9de0-47fc-9790-070d3ab57825 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:08.740897 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51684dff-9de0-47fc-9790-070d3ab57825 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:09.127340 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-bd495fca-ad8a-4dbc-b4f0-e52745c02748 req-74fbb1f0-5e93-4a45-9cd3-d1b3722b477b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5d4dee2-fea3-4713-a183-2402a1c2e66b", "name": "network-vif-deleted", "tag": "b2c46bf8-2aae-4564-a113-01d39287e407"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:09.138723 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-bd495fca-ad8a-4dbc-b4f0-e52745c02748 req-74fbb1f0-5e93-4a45-9cd3-d1b3722b477b service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:09.139169 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-bd495fca-ad8a-4dbc-b4f0-e52745c02748 req-74fbb1f0-5e93-4a45-9cd3-d1b3722b477b service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:09.153847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-bd495fca-ad8a-4dbc-b4f0-e52745c02748 req-74fbb1f0-5e93-4a45-9cd3-d1b3722b477b service nova] Creating event network-vif-deleted:b2c46bf8-2aae-4564-a113-01d39287e407 for instance b5d4dee2-fea3-4713-a183-2402a1c2e66b on hv-cinder-83588 May 10 16:50:09.163090 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-bd495fca-ad8a-4dbc-b4f0-e52745c02748 req-74fbb1f0-5e93-4a45-9cd3-d1b3722b477b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039217 May 10 16:50:09.164676 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 137/284] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:09.165707 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-51684dff-9de0-47fc-9790-070d3ab57825 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:09.179983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-51684dff-9de0-47fc-9790-070d3ab57825 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.462410 May 10 16:50:09.193831 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 148/285] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:08 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:09.387926 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:09.388348 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:09.396005 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:09.396747 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:09.397744 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:09.398343 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:09.463003 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:09.463692 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:09.464454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lazy-loading 'fault' on Instance uuid b5d4dee2-fea3-4713-a183-2402a1c2e66b {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:50:09.500246 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1e3259d1-42aa-47be-921a-662487661784 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:09.501204 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1e3259d1-42aa-47be-921a-662487661784 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:09.514535 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1e3259d1-42aa-47be-921a-662487661784 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:09.515268 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1e3259d1-42aa-47be-921a-662487661784 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:09.516346 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1e3259d1-42aa-47be-921a-662487661784 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:09.517022 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1e3259d1-42aa-47be-921a-662487661784 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:09.521910 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de59690354e4f00b10847b64c1166ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cba4b165ecb44ef8c7018958198eb36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:09.531511 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b4b54c7c-80a5-4676-b2d0-daccff4230f1 tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 200 len: 1304 microversion: 2.1 time: 0.150557 May 10 16:50:09.532094 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 138/286] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:09 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:09.704904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1e3259d1-42aa-47be-921a-662487661784 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:09.715938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1e3259d1-42aa-47be-921a-662487661784 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.220683 May 10 16:50:09.717185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 149/287] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:09 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:10.202926 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8b050be1-9080-449c-901b-8fb99ea1765c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:10.203586 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8b050be1-9080-449c-901b-8fb99ea1765c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:10.217493 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8b050be1-9080-449c-901b-8fb99ea1765c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:10.217916 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8b050be1-9080-449c-901b-8fb99ea1765c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:10.228444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8b050be1-9080-449c-901b-8fb99ea1765c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:10.228918 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8b050be1-9080-449c-901b-8fb99ea1765c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:10.461074 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8b050be1-9080-449c-901b-8fb99ea1765c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:10.470746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8b050be1-9080-449c-901b-8fb99ea1765c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.273620 May 10 16:50:10.471808 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 139/288] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:10 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:10.551457 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1d5c1760-bb8f-46a5-8ecf-527b0e0cbd0b tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:10.552742 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1d5c1760-bb8f-46a5-8ecf-527b0e0cbd0b tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] [instance: b5d4dee2-fea3-4713-a183-2402a1c2e66b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:10.560421 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1d5c1760-bb8f-46a5-8ecf-527b0e0cbd0b tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:10.561026 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1d5c1760-bb8f-46a5-8ecf-527b0e0cbd0b tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:10.562313 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1d5c1760-bb8f-46a5-8ecf-527b0e0cbd0b tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:10.563069 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1d5c1760-bb8f-46a5-8ecf-527b0e0cbd0b tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:10.590012 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-1d5c1760-bb8f-46a5-8ecf-527b0e0cbd0b tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] HTTP exception thrown: Instance b5d4dee2-fea3-4713-a183-2402a1c2e66b could not be found. May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1d5c1760-bb8f-46a5-8ecf-527b0e0cbd0b tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Request method failure captured: May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b HTTP/1.1 May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepeg54QFRq_3uDzvQMGJ_PvYBNh-2eEWK89FEFKARBkfZzyzMPy5ClSz3eoIkMT43CROpFav3__7PlAWg6v5hJnkho4PFplNy53N-273KiWD6Q5DBg_PUFvmMhO2jWb__Akg9mIKm3RAAi1TK9T9gOrOEYpjQhLOIJYJjsa236BoUcU May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 9cba4b165ecb44ef8c7018958198eb36 May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-VolumesNegativeTest-1656332800 May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:50:10.591996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9cba4b165ecb44ef8c7018958198eb36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9cba4b165ecb44ef8c7018958198eb36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9cba4b165ecb44ef8c7018958198eb36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9cba4b165ecb44ef8c7018958198eb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-VolumesNegativeTest-1656332800 May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 9cba4b165ecb44ef8c7018958198eb36 May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-VolumesNegativeTest-1656332800 May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-VolumesNegativeTest-1656332800-project May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 8de59690354e4f00b10847b64c1166ab May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-VolumesNegativeTest-1656332800-project May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance b5d4dee2-fea3-4713-a183-2402a1c2e66b could not be found. May 10 16:50:10.593339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'b5d4dee2-fea3-4713-a183-2402a1c2e66b'} May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5d4dee2-fea3-4713-a183-2402a1c2e66b could not be found. May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:50:10.594043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5d4dee2-fea3-4713-a183-2402a1c2e66b could not be found. May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5d4dee2-fea3-4713-a183-2402a1c2e66b could not be found. May 10 16:50:10.596115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:50:10.598773 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1d5c1760-bb8f-46a5-8ecf-527b0e0cbd0b tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] Returning 404 to user: Instance b5d4dee2-fea3-4713-a183-2402a1c2e66b could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:50:10.598773 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1d5c1760-bb8f-46a5-8ecf-527b0e0cbd0b tempest-VolumesNegativeTest-1656332800 tempest-VolumesNegativeTest-1656332800-project] 10.222.0.48 "GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b" status: 404 len: 111 microversion: 2.1 time: 0.047494 May 10 16:50:10.598773 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 150/289] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:10 2022] GET /compute/v2.1/servers/b5d4dee2-fea3-4713-a183-2402a1c2e66b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:50:10.739037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-dc4f3269-468a-42f7-ab13-21e276854976 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:10.741677 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-dc4f3269-468a-42f7-ab13-21e276854976 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:10.749830 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dc4f3269-468a-42f7-ab13-21e276854976 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:10.750569 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dc4f3269-468a-42f7-ab13-21e276854976 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:10.751571 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dc4f3269-468a-42f7-ab13-21e276854976 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:10.752228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dc4f3269-468a-42f7-ab13-21e276854976 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:10.979320 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-dc4f3269-468a-42f7-ab13-21e276854976 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:10.981670 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-dc4f3269-468a-42f7-ab13-21e276854976 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.247590 May 10 16:50:10.984565 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 140/290] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:10 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:11.496971 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b2c0f2ac-6555-430f-a244-5c78fc6d26cb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:11.497894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b2c0f2ac-6555-430f-a244-5c78fc6d26cb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:11.506884 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b2c0f2ac-6555-430f-a244-5c78fc6d26cb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:11.507794 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b2c0f2ac-6555-430f-a244-5c78fc6d26cb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:11.509430 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b2c0f2ac-6555-430f-a244-5c78fc6d26cb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:11.509957 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b2c0f2ac-6555-430f-a244-5c78fc6d26cb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:11.816252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b2c0f2ac-6555-430f-a244-5c78fc6d26cb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:11.824665 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b2c0f2ac-6555-430f-a244-5c78fc6d26cb tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.332338 May 10 16:50:11.826779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 151/291] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:11 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:12.002187 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-60dd3f56-53d6-4cb9-9942-6e9723487545 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:12.003043 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-60dd3f56-53d6-4cb9-9942-6e9723487545 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:12.019292 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-60dd3f56-53d6-4cb9-9942-6e9723487545 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:12.020568 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-60dd3f56-53d6-4cb9-9942-6e9723487545 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:12.021500 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-60dd3f56-53d6-4cb9-9942-6e9723487545 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:12.022076 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-60dd3f56-53d6-4cb9-9942-6e9723487545 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:12.199032 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-60dd3f56-53d6-4cb9-9942-6e9723487545 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:12.213583 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-60dd3f56-53d6-4cb9-9942-6e9723487545 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.215835 May 10 16:50:12.215564 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 141/292] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:11 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:12.852975 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-16312a39-7b00-46d6-8ab8-17bb3a4089c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:12.853528 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-16312a39-7b00-46d6-8ab8-17bb3a4089c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:12.868411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-16312a39-7b00-46d6-8ab8-17bb3a4089c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:12.874046 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-16312a39-7b00-46d6-8ab8-17bb3a4089c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:12.877657 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-16312a39-7b00-46d6-8ab8-17bb3a4089c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:12.881926 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-16312a39-7b00-46d6-8ab8-17bb3a4089c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:13.118493 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-16312a39-7b00-46d6-8ab8-17bb3a4089c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:13.134790 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-16312a39-7b00-46d6-8ab8-17bb3a4089c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.293581 May 10 16:50:13.151066 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 152/293] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:12 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:13.233066 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cf8434d9-c37d-406c-b736-69aeab896445 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:13.234279 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cf8434d9-c37d-406c-b736-69aeab896445 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:13.247778 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf8434d9-c37d-406c-b736-69aeab896445 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:13.250212 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf8434d9-c37d-406c-b736-69aeab896445 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:13.251900 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf8434d9-c37d-406c-b736-69aeab896445 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:13.252577 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf8434d9-c37d-406c-b736-69aeab896445 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:13.499929 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cf8434d9-c37d-406c-b736-69aeab896445 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:13.517082 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cf8434d9-c37d-406c-b736-69aeab896445 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.287978 May 10 16:50:13.518617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 142/294] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:13 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:14.155311 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-27a73457-453a-4d46-8c8c-ba17285e1d7e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:14.156495 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-27a73457-453a-4d46-8c8c-ba17285e1d7e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:14.171915 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-27a73457-453a-4d46-8c8c-ba17285e1d7e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:14.172889 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-27a73457-453a-4d46-8c8c-ba17285e1d7e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:14.174304 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-27a73457-453a-4d46-8c8c-ba17285e1d7e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:14.175165 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-27a73457-453a-4d46-8c8c-ba17285e1d7e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:14.351089 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-de62218e-c5d9-4b1a-9c47-af4c02f8f0d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:14.351662 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-de62218e-c5d9-4b1a-9c47-af4c02f8f0d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:14.366291 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-de62218e-c5d9-4b1a-9c47-af4c02f8f0d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:14.384376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-de62218e-c5d9-4b1a-9c47-af4c02f8f0d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:14.385564 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-de62218e-c5d9-4b1a-9c47-af4c02f8f0d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:14.386344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-de62218e-c5d9-4b1a-9c47-af4c02f8f0d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:14.507130 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-de62218e-c5d9-4b1a-9c47-af4c02f8f0d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/ips" status: 200 len: 151 microversion: 2.20 time: 0.155403 May 10 16:50:14.509574 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 143/295] 10.222.0.48 () {60 vars in 1288 bytes} [Tue May 10 16:50:14 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/ips => generated 151 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:50:14.546562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6c3971b7-5a93-4392-a166-2360fa73a3c4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:14.547181 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6c3971b7-5a93-4392-a166-2360fa73a3c4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:14.556963 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-27a73457-453a-4d46-8c8c-ba17285e1d7e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:14.557994 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6c3971b7-5a93-4392-a166-2360fa73a3c4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:14.564458 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6c3971b7-5a93-4392-a166-2360fa73a3c4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:14.565730 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6c3971b7-5a93-4392-a166-2360fa73a3c4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:14.566394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6c3971b7-5a93-4392-a166-2360fa73a3c4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:14.569957 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-27a73457-453a-4d46-8c8c-ba17285e1d7e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.417796 May 10 16:50:14.571330 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 153/296] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:14 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:14.936430 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6c3971b7-5a93-4392-a166-2360fa73a3c4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:14.951709 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6c3971b7-5a93-4392-a166-2360fa73a3c4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.414361 May 10 16:50:14.968667 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 144/297] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:14 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:15.587537 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-13badca4-fa7f-47ef-a0f1-a0cfec3ac685 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:15.588226 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-13badca4-fa7f-47ef-a0f1-a0cfec3ac685 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:15.607036 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-13badca4-fa7f-47ef-a0f1-a0cfec3ac685 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:15.607493 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-13badca4-fa7f-47ef-a0f1-a0cfec3ac685 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:15.608318 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-13badca4-fa7f-47ef-a0f1-a0cfec3ac685 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:15.608728 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-13badca4-fa7f-47ef-a0f1-a0cfec3ac685 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:15.944843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-13badca4-fa7f-47ef-a0f1-a0cfec3ac685 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:15.970934 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-13badca4-fa7f-47ef-a0f1-a0cfec3ac685 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.387158 May 10 16:50:15.972622 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 154/298] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:15 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:15.976369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0996f96d-4ae6-41bb-b152-2ecf32df24e6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:15.976980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0996f96d-4ae6-41bb-b152-2ecf32df24e6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:15.998223 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0996f96d-4ae6-41bb-b152-2ecf32df24e6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:16.003041 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0996f96d-4ae6-41bb-b152-2ecf32df24e6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:16.014822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0996f96d-4ae6-41bb-b152-2ecf32df24e6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:16.015755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0996f96d-4ae6-41bb-b152-2ecf32df24e6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:16.448197 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0996f96d-4ae6-41bb-b152-2ecf32df24e6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:16.463098 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0996f96d-4ae6-41bb-b152-2ecf32df24e6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.486984 May 10 16:50:16.473429 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 145/299] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:15 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:16.835598 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-27861f7d-e3e1-4a63-8238-711882b64176 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:16.836176 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-27861f7d-e3e1-4a63-8238-711882b64176 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:16.846388 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-27861f7d-e3e1-4a63-8238-711882b64176 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:16.846841 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-27861f7d-e3e1-4a63-8238-711882b64176 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:16.848253 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-27861f7d-e3e1-4a63-8238-711882b64176 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:16.848715 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-27861f7d-e3e1-4a63-8238-711882b64176 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:16.982695 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-27861f7d-e3e1-4a63-8238-711882b64176 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lazy-loading 'flavor' on Instance uuid c6739110-4e68-4993-83ec-7c1503f7b87b {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:50:16.990081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-02838b22-6be1-4878-bf56-9707d1e4f21d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:16.990701 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-02838b22-6be1-4878-bf56-9707d1e4f21d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:16.999332 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-02838b22-6be1-4878-bf56-9707d1e4f21d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:17.006559 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-02838b22-6be1-4878-bf56-9707d1e4f21d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:17.009809 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-02838b22-6be1-4878-bf56-9707d1e4f21d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:17.015064 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-02838b22-6be1-4878-bf56-9707d1e4f21d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:17.314074 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-02838b22-6be1-4878-bf56-9707d1e4f21d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:17.333509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-02838b22-6be1-4878-bf56-9707d1e4f21d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.347770 May 10 16:50:17.334613 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 146/300] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:16 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:17.482082 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b399709b-1617-45eb-8410-d0028c3c1415 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:17.482931 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b399709b-1617-45eb-8410-d0028c3c1415 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:17.498468 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b399709b-1617-45eb-8410-d0028c3c1415 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:17.500004 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b399709b-1617-45eb-8410-d0028c3c1415 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:17.500857 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b399709b-1617-45eb-8410-d0028c3c1415 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:17.501547 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b399709b-1617-45eb-8410-d0028c3c1415 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:17.679939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-27861f7d-e3e1-4a63-8238-711882b64176 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "POST /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/action" status: 202 len: 0 microversion: 2.20 time: 0.847522 May 10 16:50:17.681289 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 155/301] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 10 16:50:16 2022] POST /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 16:50:17.697182 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-151b464b-60d8-449e-9784-5402f0587f6f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:17.699018 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-151b464b-60d8-449e-9784-5402f0587f6f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:17.708484 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-151b464b-60d8-449e-9784-5402f0587f6f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:17.709238 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-151b464b-60d8-449e-9784-5402f0587f6f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:17.710514 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-151b464b-60d8-449e-9784-5402f0587f6f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:17.711175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-151b464b-60d8-449e-9784-5402f0587f6f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:17.835644 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b399709b-1617-45eb-8410-d0028c3c1415 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:17.844047 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b399709b-1617-45eb-8410-d0028c3c1415 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.366017 May 10 16:50:17.867154 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 147/302] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:17 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:17.947749 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-151b464b-60d8-449e-9784-5402f0587f6f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:17.965078 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-151b464b-60d8-449e-9784-5402f0587f6f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:17.966969 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-151b464b-60d8-449e-9784-5402f0587f6f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:17.968539 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-151b464b-60d8-449e-9784-5402f0587f6f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.282305 May 10 16:50:17.969945 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 156/303] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:17 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:18.355211 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-872cfada-da72-4973-ba66-aba373d1c37e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:18.355837 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-872cfada-da72-4973-ba66-aba373d1c37e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:18.366826 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-872cfada-da72-4973-ba66-aba373d1c37e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:18.367470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-872cfada-da72-4973-ba66-aba373d1c37e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:18.368047 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-872cfada-da72-4973-ba66-aba373d1c37e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:18.368510 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-872cfada-da72-4973-ba66-aba373d1c37e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:18.540505 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-872cfada-da72-4973-ba66-aba373d1c37e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:18.551035 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-872cfada-da72-4973-ba66-aba373d1c37e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.199036 May 10 16:50:18.561009 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 148/304] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:18 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:18.872633 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d71d904b-4226-4306-a3bf-a7262e565146 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:18.873338 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d71d904b-4226-4306-a3bf-a7262e565146 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:18.887326 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d71d904b-4226-4306-a3bf-a7262e565146 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:18.888113 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d71d904b-4226-4306-a3bf-a7262e565146 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:18.890649 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d71d904b-4226-4306-a3bf-a7262e565146 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:18.892900 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d71d904b-4226-4306-a3bf-a7262e565146 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:18.994804 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7dcb7c84-b145-4e31-be79-28588918261b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:18.996450 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7dcb7c84-b145-4e31-be79-28588918261b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:19.008852 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7dcb7c84-b145-4e31-be79-28588918261b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.009889 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7dcb7c84-b145-4e31-be79-28588918261b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.011248 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7dcb7c84-b145-4e31-be79-28588918261b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.012666 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7dcb7c84-b145-4e31-be79-28588918261b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.114910 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d71d904b-4226-4306-a3bf-a7262e565146 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:19.126375 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d71d904b-4226-4306-a3bf-a7262e565146 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1503 microversion: 2.1 time: 0.257783 May 10 16:50:19.127515 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 157/305] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:18 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:19.148983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-aa35d7c7-4f2d-46f2-b22c-b2e8e28a377d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc70c1cd-39a4-48ce-a4ab-d8e0a3a81c1e"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:19.150956 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-aa35d7c7-4f2d-46f2-b22c-b2e8e28a377d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:19.173263 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa35d7c7-4f2d-46f2-b22c-b2e8e28a377d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.173773 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa35d7c7-4f2d-46f2-b22c-b2e8e28a377d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.181881 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa35d7c7-4f2d-46f2-b22c-b2e8e28a377d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.182487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa35d7c7-4f2d-46f2-b22c-b2e8e28a377d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.214012 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-aa35d7c7-4f2d-46f2-b22c-b2e8e28a377d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] HTTP exception thrown: Cannot 'attach_volume' instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 while it is in vm_state rescued May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-aa35d7c7-4f2d-46f2-b22c-b2e8e28a377d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Request method failure captured: May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: POST /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8/os-volume_attachments HTTP/1.1 May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 74 May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdJR-AF-Z26xVSih2S5pNsgUpMA9h2-Krw7RrRj8d_QVb-3P4O9A7qASBY6YcTvAlFWYfInVgEslcfuVTs_Qnhf8VRyTXZHu6Hjtdi2GX-INLheW4fBj5cu-AnpIf8NHny2CNDo-adluifJHsQB9ZA56KGMRy71THEq-fiRgcDf_ec May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: f6208c73932343aeae12d8cd0983fc77 May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:50:19.215508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: f6208c73932343aeae12d8cd0983fc77 May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-ServerRescueNegativeTestJSON-1478239847-project May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 4de0f4da2d2e464fb9501fa58e344bed May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478239847-project May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {"volumeAttachment": {"volumeId": "cc70c1cd-39a4-48ce-a4ab-d8e0a3a81c1e"}} May 10 16:50:19.216984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Cannot 'attach_volume' instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 while it is in vm_state rescued May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'server_id': 'c82b30ce-5490-4df6-8d9e-12bf93154ae8', 'body': {'volumeAttachment': {'volumeId': 'cc70c1cd-39a4-48ce-a4ab-d8e0a3a81c1e'}}} May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:50:19.221913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 while it is in vm_state rescued May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:19.223752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:19.225100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:50:19.225100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:50:19.225100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 while it is in vm_state rescued May 10 16:50:19.225100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:50:19.225100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-aa35d7c7-4f2d-46f2-b22c-b2e8e28a377d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Returning 409 to user: Cannot 'attach_volume' instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 while it is in vm_state rescued {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:50:19.225100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-aa35d7c7-4f2d-46f2-b22c-b2e8e28a377d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074893 May 10 16:50:19.225100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 158/306] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:50:19 2022] POST /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 16:50:19.236248 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0ca5b7f8-344b-4d95-a8e2-a4697e843d00 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:19.237344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0ca5b7f8-344b-4d95-a8e2-a4697e843d00 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:19.245636 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0ca5b7f8-344b-4d95-a8e2-a4697e843d00 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.246088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0ca5b7f8-344b-4d95-a8e2-a4697e843d00 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.247066 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0ca5b7f8-344b-4d95-a8e2-a4697e843d00 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.247707 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0ca5b7f8-344b-4d95-a8e2-a4697e843d00 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.286033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7dcb7c84-b145-4e31-be79-28588918261b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:19.297615 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7dcb7c84-b145-4e31-be79-28588918261b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:19.302531 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7dcb7c84-b145-4e31-be79-28588918261b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:19.307989 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7dcb7c84-b145-4e31-be79-28588918261b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.317197 May 10 16:50:19.315254 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 149/307] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:18 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:19.435428 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0ca5b7f8-344b-4d95-a8e2-a4697e843d00 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8/action" status: 202 len: 0 microversion: 2.1 time: 0.211320 May 10 16:50:19.439085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 159/308] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:50:19 2022] POST /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:50:19.450893 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3c948fb6-cb97-4eac-8f57-b9d77e5c8ff2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:19.451519 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3c948fb6-cb97-4eac-8f57-b9d77e5c8ff2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:19.469448 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3c948fb6-cb97-4eac-8f57-b9d77e5c8ff2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.470228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3c948fb6-cb97-4eac-8f57-b9d77e5c8ff2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.471582 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3c948fb6-cb97-4eac-8f57-b9d77e5c8ff2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.472329 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3c948fb6-cb97-4eac-8f57-b9d77e5c8ff2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.569736 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-67d00cc3-5000-41bc-9dae-53420dcc8213 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:19.570470 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-67d00cc3-5000-41bc-9dae-53420dcc8213 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:19.597510 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-67d00cc3-5000-41bc-9dae-53420dcc8213 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.598409 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-67d00cc3-5000-41bc-9dae-53420dcc8213 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.601444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-67d00cc3-5000-41bc-9dae-53420dcc8213 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.603314 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-67d00cc3-5000-41bc-9dae-53420dcc8213 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.849829 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3c948fb6-cb97-4eac-8f57-b9d77e5c8ff2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:19.861676 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3c948fb6-cb97-4eac-8f57-b9d77e5c8ff2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1511 microversion: 2.1 time: 0.416231 May 10 16:50:19.872917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 150/309] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:19 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1511 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:20.116659 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-67d00cc3-5000-41bc-9dae-53420dcc8213 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:20.125688 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-67d00cc3-5000-41bc-9dae-53420dcc8213 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.560968 May 10 16:50:20.126932 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 160/310] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:19 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:20.338883 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-127c8ef9-4286-4598-b3c6-b9ec35b30b82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:20.339565 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-127c8ef9-4286-4598-b3c6-b9ec35b30b82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:20.358680 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-127c8ef9-4286-4598-b3c6-b9ec35b30b82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:20.359598 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-127c8ef9-4286-4598-b3c6-b9ec35b30b82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:20.360514 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-127c8ef9-4286-4598-b3c6-b9ec35b30b82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:20.360991 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-127c8ef9-4286-4598-b3c6-b9ec35b30b82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:20.683176 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-127c8ef9-4286-4598-b3c6-b9ec35b30b82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:20.709513 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-127c8ef9-4286-4598-b3c6-b9ec35b30b82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:20.717087 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-127c8ef9-4286-4598-b3c6-b9ec35b30b82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:20.721933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-127c8ef9-4286-4598-b3c6-b9ec35b30b82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.387969 May 10 16:50:20.730032 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 151/311] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:20 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:50:20.886272 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-285e3905-f8ea-474d-b1a1-da4ed54d8a17 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:20.887288 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-285e3905-f8ea-474d-b1a1-da4ed54d8a17 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:20.903826 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-285e3905-f8ea-474d-b1a1-da4ed54d8a17 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:20.904189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-285e3905-f8ea-474d-b1a1-da4ed54d8a17 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:20.910802 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-285e3905-f8ea-474d-b1a1-da4ed54d8a17 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:20.912510 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-285e3905-f8ea-474d-b1a1-da4ed54d8a17 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:21.145744 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0236cf78-be10-4758-92b4-95221e74c391 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:21.146408 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0236cf78-be10-4758-92b4-95221e74c391 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:21.161399 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0236cf78-be10-4758-92b4-95221e74c391 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:21.163118 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0236cf78-be10-4758-92b4-95221e74c391 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:21.167341 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0236cf78-be10-4758-92b4-95221e74c391 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:21.170747 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0236cf78-be10-4758-92b4-95221e74c391 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:21.212088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-285e3905-f8ea-474d-b1a1-da4ed54d8a17 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:21.229594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-285e3905-f8ea-474d-b1a1-da4ed54d8a17 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1511 microversion: 2.1 time: 0.349482 May 10 16:50:21.230565 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 161/312] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:20 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:21.670931 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0236cf78-be10-4758-92b4-95221e74c391 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:21.688068 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0236cf78-be10-4758-92b4-95221e74c391 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.548302 May 10 16:50:21.692709 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 152/313] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:21 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:21.744737 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e68bd8c5-3321-49ca-b270-c52992044791 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:21.746023 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e68bd8c5-3321-49ca-b270-c52992044791 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:21.762446 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e68bd8c5-3321-49ca-b270-c52992044791 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:21.763202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e68bd8c5-3321-49ca-b270-c52992044791 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:21.764261 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e68bd8c5-3321-49ca-b270-c52992044791 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:21.764915 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e68bd8c5-3321-49ca-b270-c52992044791 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:21.964609 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e68bd8c5-3321-49ca-b270-c52992044791 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:21.974525 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e68bd8c5-3321-49ca-b270-c52992044791 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:21.977136 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e68bd8c5-3321-49ca-b270-c52992044791 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:21.978268 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e68bd8c5-3321-49ca-b270-c52992044791 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.241577 May 10 16:50:21.981255 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 162/314] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:21 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:22.257119 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9a589c58-742a-43b4-ab21-bb9546cc4437 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:22.258063 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9a589c58-742a-43b4-ab21-bb9546cc4437 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:22.264739 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9a589c58-742a-43b4-ab21-bb9546cc4437 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:22.265509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9a589c58-742a-43b4-ab21-bb9546cc4437 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:22.266547 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9a589c58-742a-43b4-ab21-bb9546cc4437 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:22.267185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9a589c58-742a-43b4-ab21-bb9546cc4437 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:22.475647 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9a589c58-742a-43b4-ab21-bb9546cc4437 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:22.485355 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9a589c58-742a-43b4-ab21-bb9546cc4437 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1511 microversion: 2.1 time: 0.239944 May 10 16:50:22.497683 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 153/315] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:22 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1511 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:22.708635 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ce57e502-a874-4342-b552-0775e468b390 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:22.709517 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ce57e502-a874-4342-b552-0775e468b390 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:22.717044 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce57e502-a874-4342-b552-0775e468b390 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:22.719410 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce57e502-a874-4342-b552-0775e468b390 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:22.720900 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce57e502-a874-4342-b552-0775e468b390 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:22.721925 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce57e502-a874-4342-b552-0775e468b390 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:22.954182 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ce57e502-a874-4342-b552-0775e468b390 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:22.981112 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ce57e502-a874-4342-b552-0775e468b390 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.276442 May 10 16:50:22.983173 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 163/316] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:22 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:23.000060 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-05879c07-605b-4498-aba2-f3a4e28d2d02 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:23.000850 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-05879c07-605b-4498-aba2-f3a4e28d2d02 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:23.020960 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-05879c07-605b-4498-aba2-f3a4e28d2d02 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:23.021402 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-05879c07-605b-4498-aba2-f3a4e28d2d02 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:23.022573 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-05879c07-605b-4498-aba2-f3a4e28d2d02 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:23.023145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-05879c07-605b-4498-aba2-f3a4e28d2d02 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:23.462467 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-05879c07-605b-4498-aba2-f3a4e28d2d02 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:23.476483 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-05879c07-605b-4498-aba2-f3a4e28d2d02 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:23.478710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-05879c07-605b-4498-aba2-f3a4e28d2d02 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:23.480348 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-05879c07-605b-4498-aba2-f3a4e28d2d02 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.484329 May 10 16:50:23.492597 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 154/317] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:22 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:23.503038 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8551b15f-e975-4dba-b1cf-15237b0a016a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:23.503740 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8551b15f-e975-4dba-b1cf-15237b0a016a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:23.512329 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8551b15f-e975-4dba-b1cf-15237b0a016a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:23.515362 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8551b15f-e975-4dba-b1cf-15237b0a016a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:23.516753 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8551b15f-e975-4dba-b1cf-15237b0a016a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:23.517859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8551b15f-e975-4dba-b1cf-15237b0a016a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:23.757332 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8551b15f-e975-4dba-b1cf-15237b0a016a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:23.774789 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8551b15f-e975-4dba-b1cf-15237b0a016a tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1511 microversion: 2.1 time: 0.269199 May 10 16:50:23.786302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 164/318] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:23 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1511 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:24.008260 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4f33d6cd-8797-4569-a4f0-edfd7e4d490b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:24.009316 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4f33d6cd-8797-4569-a4f0-edfd7e4d490b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:24.019225 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4f33d6cd-8797-4569-a4f0-edfd7e4d490b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:24.019942 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4f33d6cd-8797-4569-a4f0-edfd7e4d490b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:24.021343 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4f33d6cd-8797-4569-a4f0-edfd7e4d490b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:24.022095 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4f33d6cd-8797-4569-a4f0-edfd7e4d490b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:24.179503 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4f33d6cd-8797-4569-a4f0-edfd7e4d490b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:24.187716 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4f33d6cd-8797-4569-a4f0-edfd7e4d490b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1723 microversion: 2.1 time: 0.186048 May 10 16:50:24.188619 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 155/319] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:24 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:24.499415 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-823bf3d3-924f-44ab-9fbc-c635a2ad23ea tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:24.500347 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-823bf3d3-924f-44ab-9fbc-c635a2ad23ea tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:24.507522 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-823bf3d3-924f-44ab-9fbc-c635a2ad23ea tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:24.507981 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-823bf3d3-924f-44ab-9fbc-c635a2ad23ea tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:24.508804 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-823bf3d3-924f-44ab-9fbc-c635a2ad23ea tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:24.509350 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-823bf3d3-924f-44ab-9fbc-c635a2ad23ea tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:24.651733 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-823bf3d3-924f-44ab-9fbc-c635a2ad23ea tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:24.660612 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-823bf3d3-924f-44ab-9fbc-c635a2ad23ea tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:24.662114 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-823bf3d3-924f-44ab-9fbc-c635a2ad23ea tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:24.663273 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-823bf3d3-924f-44ab-9fbc-c635a2ad23ea tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.167814 May 10 16:50:24.663827 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 165/320] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:24 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:24.795214 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c39665af-2fbc-417e-90b3-08716af4fe8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:24.795733 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c39665af-2fbc-417e-90b3-08716af4fe8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:24.802001 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c39665af-2fbc-417e-90b3-08716af4fe8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:24.802446 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c39665af-2fbc-417e-90b3-08716af4fe8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:24.803219 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c39665af-2fbc-417e-90b3-08716af4fe8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:24.803657 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c39665af-2fbc-417e-90b3-08716af4fe8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:24.934261 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c39665af-2fbc-417e-90b3-08716af4fe8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:24.943203 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c39665af-2fbc-417e-90b3-08716af4fe8c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1511 microversion: 2.1 time: 0.151918 May 10 16:50:24.944007 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 156/321] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:24 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:25.205698 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-df310a77-ab37-48ce-9512-ebe9be554234 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:25.207063 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-df310a77-ab37-48ce-9512-ebe9be554234 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:25.213522 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-df310a77-ab37-48ce-9512-ebe9be554234 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:25.213973 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-df310a77-ab37-48ce-9512-ebe9be554234 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:25.214752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-df310a77-ab37-48ce-9512-ebe9be554234 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:25.215187 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-df310a77-ab37-48ce-9512-ebe9be554234 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:25.352266 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-df310a77-ab37-48ce-9512-ebe9be554234 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:25.365012 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-df310a77-ab37-48ce-9512-ebe9be554234 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1700 microversion: 2.1 time: 0.163203 May 10 16:50:25.365585 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 166/322] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:25 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1700 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:25.382195 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-dcc20e1f-a2fb-4157-aef3-f36401809599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:25.388938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dcc20e1f-a2fb-4157-aef3-f36401809599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:25.389390 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dcc20e1f-a2fb-4157-aef3-f36401809599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:25.412822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-dcc20e1f-a2fb-4157-aef3-f36401809599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Going to try to start instance {{(pid=134194) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 16:50:25.463820 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-dcc20e1f-a2fb-4157-aef3-f36401809599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/action" status: 202 len: 0 microversion: 2.1 time: 0.085965 May 10 16:50:25.464740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 157/323] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:50:25 2022] POST /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:50:25.475086 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3bd7eef5-7ec6-42e4-8823-1fda65439878 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:25.475713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3bd7eef5-7ec6-42e4-8823-1fda65439878 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:25.477557 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1486291614", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "networks": [{"uuid": "86c89ebc-58b3-49c4-b16f-4293e1e93d33"}]}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:25.484830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3bd7eef5-7ec6-42e4-8823-1fda65439878 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:25.485449 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3bd7eef5-7ec6-42e4-8823-1fda65439878 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:25.486259 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3bd7eef5-7ec6-42e4-8823-1fda65439878 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:25.486706 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3bd7eef5-7ec6-42e4-8823-1fda65439878 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:25.546226 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] validate_networks() for [('86c89ebc-58b3-49c4-b16f-4293e1e93d33', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:50:25.679844 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3bd7eef5-7ec6-42e4-8823-1fda65439878 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:25.688422 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3bd7eef5-7ec6-42e4-8823-1fda65439878 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1709 microversion: 2.1 time: 0.218786 May 10 16:50:25.689521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 167/324] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:25 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1709 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:25.696996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d05f2ff9-4b2c-429b-9863-35243b615313 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:25.697765 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d05f2ff9-4b2c-429b-9863-35243b615313 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:25.705880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d05f2ff9-4b2c-429b-9863-35243b615313 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:25.706805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d05f2ff9-4b2c-429b-9863-35243b615313 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:25.708664 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d05f2ff9-4b2c-429b-9863-35243b615313 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:25.709316 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d05f2ff9-4b2c-429b-9863-35243b615313 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:26.007582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d05f2ff9-4b2c-429b-9863-35243b615313 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:26.020671 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d05f2ff9-4b2c-429b-9863-35243b615313 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:26.022355 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d05f2ff9-4b2c-429b-9863-35243b615313 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:26.023598 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d05f2ff9-4b2c-429b-9863-35243b615313 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.332478 May 10 16:50:26.030363 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 168/325] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:25 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:26.041231 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-317a9ee7-51fe-41ac-86b3-d921bff0f713 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:26.042227 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-317a9ee7-51fe-41ac-86b3-d921bff0f713 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:26.052588 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-317a9ee7-51fe-41ac-86b3-d921bff0f713 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:26.053045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-317a9ee7-51fe-41ac-86b3-d921bff0f713 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:26.055654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-317a9ee7-51fe-41ac-86b3-d921bff0f713 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:26.056332 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-317a9ee7-51fe-41ac-86b3-d921bff0f713 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:26.083356 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:50:26.084014 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:50:26.084529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:50:26.084939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:50:26.085352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:50:26.095400 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:26.095851 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:26.096715 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:26.097304 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:26.115646 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Getting quotas for project ea67afdf22fd4b41ac5f34bc29f3b7b8. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:50:26.119894 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Getting quotas for user dd61c2b29a8e448e9d18ac20959f3e1d and project ea67afdf22fd4b41ac5f34bc29f3b7b8. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:50:26.131761 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:50:26.134167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:50:26.184517 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b64d05c8-86a5-44a1-8960-cfc01d9d3ec8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712735 May 10 16:50:26.185377 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 158/326] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:50:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 16:50:26.196099 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7595d528-e76d-4325-bd6e-c55777fae382 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:26.196657 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7595d528-e76d-4325-bd6e-c55777fae382 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:26.259102 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7595d528-e76d-4325-bd6e-c55777fae382 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:26.266643 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7595d528-e76d-4325-bd6e-c55777fae382 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1219 microversion: 2.1 time: 0.074123 May 10 16:50:26.267959 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 159/327] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:26 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:26.278805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-317a9ee7-51fe-41ac-86b3-d921bff0f713 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:26.290592 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-317a9ee7-51fe-41ac-86b3-d921bff0f713 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1517 microversion: 2.1 time: 0.258858 May 10 16:50:26.291545 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 169/328] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:26 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:26.706896 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4c660a75-6d74-4fb3-ac5f-1393b51b8edc tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:26.707606 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4c660a75-6d74-4fb3-ac5f-1393b51b8edc tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:26.724768 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c660a75-6d74-4fb3-ac5f-1393b51b8edc tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:26.725227 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c660a75-6d74-4fb3-ac5f-1393b51b8edc tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:26.726029 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c660a75-6d74-4fb3-ac5f-1393b51b8edc tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:26.726461 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c660a75-6d74-4fb3-ac5f-1393b51b8edc tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:26.867065 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4c660a75-6d74-4fb3-ac5f-1393b51b8edc tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:26.875066 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4c660a75-6d74-4fb3-ac5f-1393b51b8edc tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1709 microversion: 2.1 time: 0.172269 May 10 16:50:26.875642 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 160/329] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:26 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:27.043225 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4639f73b-1241-4c17-919a-93bfc567d59d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:27.043838 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4639f73b-1241-4c17-919a-93bfc567d59d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:27.051232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4639f73b-1241-4c17-919a-93bfc567d59d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:27.051686 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4639f73b-1241-4c17-919a-93bfc567d59d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:27.052496 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4639f73b-1241-4c17-919a-93bfc567d59d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:27.052937 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4639f73b-1241-4c17-919a-93bfc567d59d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:27.287212 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-77296911-a5d4-4b72-9b5d-8b518e6936ac tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:27.289627 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-77296911-a5d4-4b72-9b5d-8b518e6936ac tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:27.294269 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-77296911-a5d4-4b72-9b5d-8b518e6936ac tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:27.294721 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-77296911-a5d4-4b72-9b5d-8b518e6936ac tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:27.295506 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-77296911-a5d4-4b72-9b5d-8b518e6936ac tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:27.295941 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-77296911-a5d4-4b72-9b5d-8b518e6936ac tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:27.365973 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-77296911-a5d4-4b72-9b5d-8b518e6936ac tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:27.373972 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-77296911-a5d4-4b72-9b5d-8b518e6936ac tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1223 microversion: 2.1 time: 0.091331 May 10 16:50:27.374554 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 161/330] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:27 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:27.470864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4639f73b-1241-4c17-919a-93bfc567d59d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:27.480128 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4639f73b-1241-4c17-919a-93bfc567d59d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:27.481682 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4639f73b-1241-4c17-919a-93bfc567d59d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:27.483180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4639f73b-1241-4c17-919a-93bfc567d59d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.443926 May 10 16:50:27.483848 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 170/331] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:27 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:27.892690 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-52052657-65a9-4a00-b8c0-7598ff221aa8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:27.893291 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-52052657-65a9-4a00-b8c0-7598ff221aa8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:27.899797 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-52052657-65a9-4a00-b8c0-7598ff221aa8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:27.900237 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-52052657-65a9-4a00-b8c0-7598ff221aa8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:27.901073 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-52052657-65a9-4a00-b8c0-7598ff221aa8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:27.901501 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-52052657-65a9-4a00-b8c0-7598ff221aa8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:28.031838 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-52052657-65a9-4a00-b8c0-7598ff221aa8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:28.040720 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-52052657-65a9-4a00-b8c0-7598ff221aa8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1709 microversion: 2.1 time: 0.151809 May 10 16:50:28.043188 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 162/332] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:27 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:28.390900 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ce497385-9256-4686-aa4d-69b5600493b3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:28.391505 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ce497385-9256-4686-aa4d-69b5600493b3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:28.398866 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce497385-9256-4686-aa4d-69b5600493b3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:28.399316 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce497385-9256-4686-aa4d-69b5600493b3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:28.400099 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce497385-9256-4686-aa4d-69b5600493b3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:28.400582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce497385-9256-4686-aa4d-69b5600493b3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:28.463790 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ce497385-9256-4686-aa4d-69b5600493b3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:28.471341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ce497385-9256-4686-aa4d-69b5600493b3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1223 microversion: 2.1 time: 0.084212 May 10 16:50:28.472557 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 171/333] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:28 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:28.502262 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f454ac50-126f-4f90-a33f-6f420dbb21a8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:28.502868 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f454ac50-126f-4f90-a33f-6f420dbb21a8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:28.508906 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f454ac50-126f-4f90-a33f-6f420dbb21a8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:28.509360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f454ac50-126f-4f90-a33f-6f420dbb21a8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:28.510178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f454ac50-126f-4f90-a33f-6f420dbb21a8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:28.510623 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f454ac50-126f-4f90-a33f-6f420dbb21a8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:28.654632 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f454ac50-126f-4f90-a33f-6f420dbb21a8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:28.663755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f454ac50-126f-4f90-a33f-6f420dbb21a8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:28.665320 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f454ac50-126f-4f90-a33f-6f420dbb21a8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:28.666493 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f454ac50-126f-4f90-a33f-6f420dbb21a8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.168289 May 10 16:50:28.667089 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 163/334] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:28 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:29.058696 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-80f8f238-8b7a-4fce-bb64-c3893c80e1c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:29.059306 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-80f8f238-8b7a-4fce-bb64-c3893c80e1c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:29.065236 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-80f8f238-8b7a-4fce-bb64-c3893c80e1c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:29.066481 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-80f8f238-8b7a-4fce-bb64-c3893c80e1c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:29.067296 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-80f8f238-8b7a-4fce-bb64-c3893c80e1c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:29.068378 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-80f8f238-8b7a-4fce-bb64-c3893c80e1c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:29.214475 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-80f8f238-8b7a-4fce-bb64-c3893c80e1c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:29.224288 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-80f8f238-8b7a-4fce-bb64-c3893c80e1c0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1709 microversion: 2.1 time: 0.169259 May 10 16:50:29.224874 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 172/335] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:29 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:29.488844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-23bd8bcd-0fc7-45a8-8c0c-36a2e73ffad8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:29.489531 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-23bd8bcd-0fc7-45a8-8c0c-36a2e73ffad8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:29.495935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-23bd8bcd-0fc7-45a8-8c0c-36a2e73ffad8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:29.496426 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-23bd8bcd-0fc7-45a8-8c0c-36a2e73ffad8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:29.497209 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-23bd8bcd-0fc7-45a8-8c0c-36a2e73ffad8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:29.497648 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-23bd8bcd-0fc7-45a8-8c0c-36a2e73ffad8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:29.564423 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-23bd8bcd-0fc7-45a8-8c0c-36a2e73ffad8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:29.578161 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-23bd8bcd-0fc7-45a8-8c0c-36a2e73ffad8 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1279 microversion: 2.1 time: 0.093291 May 10 16:50:29.578688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 164/336] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:29 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1279 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:29.690200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-745f37e2-a3aa-494d-b80f-84fb0038aae6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:29.691612 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-745f37e2-a3aa-494d-b80f-84fb0038aae6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:29.704166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-745f37e2-a3aa-494d-b80f-84fb0038aae6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:29.705005 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-745f37e2-a3aa-494d-b80f-84fb0038aae6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:29.706687 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-745f37e2-a3aa-494d-b80f-84fb0038aae6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:29.708962 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-745f37e2-a3aa-494d-b80f-84fb0038aae6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:29.799285 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-44c6f395-0532-4e9a-8df3-4693668410a0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'create', calling method: .version_select at 0x7f5fb6dd6b80>, body: {"keypair": {"name": "tempest-keypair-1141403721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlSIjLksptoAYa3BDcooCRDzV+fXoVO9rSCsp/7DuyJqKbusGQet4bErL/Bno1UoJeCv4MvsZXTcG62H7zATbPnCc8P1fT1ofrITOC2QuQB1+wyPR1/YQcJKbjhSE3MBw=="}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:29.818029 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-44c6f395-0532-4e9a-8df3-4693668410a0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Getting quotas for project f6208c73932343aeae12d8cd0983fc77. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:50:29.823042 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-44c6f395-0532-4e9a-8df3-4693668410a0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Getting quotas for user 4de0f4da2d2e464fb9501fa58e344bed and project f6208c73932343aeae12d8cd0983fc77. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:50:29.853272 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-44c6f395-0532-4e9a-8df3-4693668410a0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058587 May 10 16:50:29.854048 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 165/337] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 10 16:50:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:50:29.937358 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-745f37e2-a3aa-494d-b80f-84fb0038aae6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:29.947197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-745f37e2-a3aa-494d-b80f-84fb0038aae6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:29.948809 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-745f37e2-a3aa-494d-b80f-84fb0038aae6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:29.950150 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-745f37e2-a3aa-494d-b80f-84fb0038aae6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.267709 May 10 16:50:29.950880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 173/338] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:29 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:50:30.242836 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-26332af7-9d6b-4ee3-aefa-2aefd56b93f6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:30.243794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-26332af7-9d6b-4ee3-aefa-2aefd56b93f6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:30.250868 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-26332af7-9d6b-4ee3-aefa-2aefd56b93f6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:30.251545 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-26332af7-9d6b-4ee3-aefa-2aefd56b93f6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:30.252825 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-26332af7-9d6b-4ee3-aefa-2aefd56b93f6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:30.254049 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-26332af7-9d6b-4ee3-aefa-2aefd56b93f6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:30.593307 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-26332af7-9d6b-4ee3-aefa-2aefd56b93f6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:30.595596 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a4615d57-93d9-4426-b707-d0817baba8b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:30.596214 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a4615d57-93d9-4426-b707-d0817baba8b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:30.605100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a4615d57-93d9-4426-b707-d0817baba8b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:30.605557 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a4615d57-93d9-4426-b707-d0817baba8b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:30.610527 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-26332af7-9d6b-4ee3-aefa-2aefd56b93f6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1713 microversion: 2.1 time: 0.371684 May 10 16:50:30.611748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 166/339] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:30 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1713 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:30.618799 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a4615d57-93d9-4426-b707-d0817baba8b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:30.619591 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a4615d57-93d9-4426-b707-d0817baba8b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:30.969786 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a7a771e2-89ad-4813-908b-d072784c8bdb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:30.970820 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a7a771e2-89ad-4813-908b-d072784c8bdb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:30.980592 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a7a771e2-89ad-4813-908b-d072784c8bdb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:30.981143 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a7a771e2-89ad-4813-908b-d072784c8bdb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:30.982006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a7a771e2-89ad-4813-908b-d072784c8bdb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:30.982542 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a7a771e2-89ad-4813-908b-d072784c8bdb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:31.056696 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a4615d57-93d9-4426-b707-d0817baba8b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:31.066745 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a4615d57-93d9-4426-b707-d0817baba8b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.475589 May 10 16:50:31.068254 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 174/340] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:30 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:31.159830 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a7a771e2-89ad-4813-908b-d072784c8bdb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:31.169194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a7a771e2-89ad-4813-908b-d072784c8bdb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:31.170888 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a7a771e2-89ad-4813-908b-d072784c8bdb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:31.172059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a7a771e2-89ad-4813-908b-d072784c8bdb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.206954 May 10 16:50:31.172722 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 167/341] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:30 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:50:31.941345 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-568019e5-036c-42cb-813f-360e5eafb325 req-59106c6e-d14a-4c41-b3f9-dee80725c4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aecdb938-f6bb-4133-bbf8-f4b9645ce76a", "tag": "c9672453-af7a-47d3-b2cc-46ead0204f1d"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:31.952471 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-568019e5-036c-42cb-813f-360e5eafb325 req-59106c6e-d14a-4c41-b3f9-dee80725c4a5 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:31.953322 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-568019e5-036c-42cb-813f-360e5eafb325 req-59106c6e-d14a-4c41-b3f9-dee80725c4a5 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:31.970168 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-568019e5-036c-42cb-813f-360e5eafb325 req-59106c6e-d14a-4c41-b3f9-dee80725c4a5 service nova] Creating event network-changed:c9672453-af7a-47d3-b2cc-46ead0204f1d for instance aecdb938-f6bb-4133-bbf8-f4b9645ce76a on hv-cinder-83588 May 10 16:50:31.977274 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-568019e5-036c-42cb-813f-360e5eafb325 req-59106c6e-d14a-4c41-b3f9-dee80725c4a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039724 May 10 16:50:31.979116 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 175/342] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:32.086897 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2ba70a28-a359-41a1-b9a6-b6aa812fec99 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:32.087710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2ba70a28-a359-41a1-b9a6-b6aa812fec99 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:32.095291 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2ba70a28-a359-41a1-b9a6-b6aa812fec99 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:32.095291 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2ba70a28-a359-41a1-b9a6-b6aa812fec99 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:32.095642 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2ba70a28-a359-41a1-b9a6-b6aa812fec99 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:32.096159 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2ba70a28-a359-41a1-b9a6-b6aa812fec99 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:32.198980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ce2920fb-f543-45ad-9ab6-21b50a07b8db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:32.200489 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ce2920fb-f543-45ad-9ab6-21b50a07b8db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:32.217514 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce2920fb-f543-45ad-9ab6-21b50a07b8db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:32.217514 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce2920fb-f543-45ad-9ab6-21b50a07b8db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:32.217514 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce2920fb-f543-45ad-9ab6-21b50a07b8db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:32.218563 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce2920fb-f543-45ad-9ab6-21b50a07b8db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:32.266216 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2ba70a28-a359-41a1-b9a6-b6aa812fec99 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:32.276646 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2ba70a28-a359-41a1-b9a6-b6aa812fec99 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.195468 May 10 16:50:32.277575 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 168/343] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:32 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:32.443670 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ce2920fb-f543-45ad-9ab6-21b50a07b8db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:32.452577 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ce2920fb-f543-45ad-9ab6-21b50a07b8db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:32.454378 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ce2920fb-f543-45ad-9ab6-21b50a07b8db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:32.455731 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ce2920fb-f543-45ad-9ab6-21b50a07b8db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.266871 May 10 16:50:32.456883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 176/344] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:32 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:32.501420 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1912748694", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5732deb1-fb33-4f08-9ad5-7d92102702ad"}], "security_groups": [{"name": "tempest-securitygroup--461896974"}], "key_name": "tempest-keypair-1141403721", "user_data": "}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:32.612029 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] validate_networks() for [('5732deb1-fb33-4f08-9ad5-7d92102702ad', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:50:33.016204 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:50:33.016659 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:50:33.017199 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:50:33.017608 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:50:33.018012 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:50:33.027045 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:33.027494 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:33.028325 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:33.028771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:33.048652 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Getting quotas for project f6208c73932343aeae12d8cd0983fc77. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:50:33.053966 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Getting quotas for user 4de0f4da2d2e464fb9501fa58e344bed and project f6208c73932343aeae12d8cd0983fc77. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:50:33.065115 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:50:33.067924 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:50:33.117081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9f8e9ece-f3bd-4eeb-b5c6-e16b227f10f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.620270 May 10 16:50:33.117733 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 169/345] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:50:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:50:33.129012 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-75c73fb2-89bf-4681-88cb-59f2cc9fb6d0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:33.129916 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-75c73fb2-89bf-4681-88cb-59f2cc9fb6d0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:33.185887 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-75c73fb2-89bf-4681-88cb-59f2cc9fb6d0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:33.197190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-75c73fb2-89bf-4681-88cb-59f2cc9fb6d0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1246 microversion: 2.1 time: 0.072898 May 10 16:50:33.201251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 177/346] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:33 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:33.295217 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d799e000-bb49-46d0-aeed-1e743209fca4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:33.295882 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d799e000-bb49-46d0-aeed-1e743209fca4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:33.303314 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d799e000-bb49-46d0-aeed-1e743209fca4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:33.303911 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d799e000-bb49-46d0-aeed-1e743209fca4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:33.304647 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d799e000-bb49-46d0-aeed-1e743209fca4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:33.305087 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d799e000-bb49-46d0-aeed-1e743209fca4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:33.454701 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d799e000-bb49-46d0-aeed-1e743209fca4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:33.462467 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d799e000-bb49-46d0-aeed-1e743209fca4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.171279 May 10 16:50:33.463057 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 170/347] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:33 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:33.478378 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0d77b9c9-5187-4cb9-8deb-5fbdfeacaa1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:33.479020 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0d77b9c9-5187-4cb9-8deb-5fbdfeacaa1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:33.486227 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0d77b9c9-5187-4cb9-8deb-5fbdfeacaa1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:33.490061 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0d77b9c9-5187-4cb9-8deb-5fbdfeacaa1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:33.490061 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0d77b9c9-5187-4cb9-8deb-5fbdfeacaa1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:33.490061 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0d77b9c9-5187-4cb9-8deb-5fbdfeacaa1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:33.625774 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-0d77b9c9-5187-4cb9-8deb-5fbdfeacaa1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:33.634874 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-0d77b9c9-5187-4cb9-8deb-5fbdfeacaa1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:33.636433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-0d77b9c9-5187-4cb9-8deb-5fbdfeacaa1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:33.637602 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0d77b9c9-5187-4cb9-8deb-5fbdfeacaa1a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.163466 May 10 16:50:33.638199 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 178/348] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:33 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:34.215042 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-48497513-3446-4ade-8eb9-d19a8283d86b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:34.215695 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-48497513-3446-4ade-8eb9-d19a8283d86b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:34.221787 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-48497513-3446-4ade-8eb9-d19a8283d86b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:34.222237 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-48497513-3446-4ade-8eb9-d19a8283d86b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:34.223023 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-48497513-3446-4ade-8eb9-d19a8283d86b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:34.223459 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-48497513-3446-4ade-8eb9-d19a8283d86b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:34.285578 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-48497513-3446-4ade-8eb9-d19a8283d86b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:34.293124 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-48497513-3446-4ade-8eb9-d19a8283d86b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1250 microversion: 2.1 time: 0.081936 May 10 16:50:34.293708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 171/349] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:34 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:34.480694 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-44467b3e-d26c-4c5d-bf99-5ea8666456b2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:34.481220 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-44467b3e-d26c-4c5d-bf99-5ea8666456b2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:34.488317 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-44467b3e-d26c-4c5d-bf99-5ea8666456b2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:34.488776 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-44467b3e-d26c-4c5d-bf99-5ea8666456b2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:34.489755 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-44467b3e-d26c-4c5d-bf99-5ea8666456b2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:34.490313 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-44467b3e-d26c-4c5d-bf99-5ea8666456b2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:34.623003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-44467b3e-d26c-4c5d-bf99-5ea8666456b2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:34.631048 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-44467b3e-d26c-4c5d-bf99-5ea8666456b2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.154479 May 10 16:50:34.631634 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 179/350] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:34 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:34.662155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-76b323d6-7e92-4020-9966-710ce003dc51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:34.663172 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-76b323d6-7e92-4020-9966-710ce003dc51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:34.670221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-76b323d6-7e92-4020-9966-710ce003dc51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:34.670667 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-76b323d6-7e92-4020-9966-710ce003dc51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:34.671459 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-76b323d6-7e92-4020-9966-710ce003dc51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:34.671894 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-76b323d6-7e92-4020-9966-710ce003dc51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:34.811223 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-76b323d6-7e92-4020-9966-710ce003dc51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:34.819425 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-76b323d6-7e92-4020-9966-710ce003dc51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:34.820995 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-76b323d6-7e92-4020-9966-710ce003dc51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:34.822187 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-76b323d6-7e92-4020-9966-710ce003dc51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.167322 May 10 16:50:34.822754 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 172/351] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:34 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:35.309535 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-17bed57e-92d2-4a2b-b29c-488b7dbd4672 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:35.310262 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-17bed57e-92d2-4a2b-b29c-488b7dbd4672 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:35.317354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-17bed57e-92d2-4a2b-b29c-488b7dbd4672 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.317910 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-17bed57e-92d2-4a2b-b29c-488b7dbd4672 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.318781 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-17bed57e-92d2-4a2b-b29c-488b7dbd4672 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.319221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-17bed57e-92d2-4a2b-b29c-488b7dbd4672 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.402192 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-17bed57e-92d2-4a2b-b29c-488b7dbd4672 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:35.411505 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-17bed57e-92d2-4a2b-b29c-488b7dbd4672 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1242 microversion: 2.1 time: 0.106038 May 10 16:50:35.412292 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 180/352] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:35 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:35.651898 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-82457da8-2d56-4968-9072-bec16f2366c3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:35.652990 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-82457da8-2d56-4968-9072-bec16f2366c3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:35.663065 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-82457da8-2d56-4968-9072-bec16f2366c3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.663521 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-82457da8-2d56-4968-9072-bec16f2366c3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.664338 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-82457da8-2d56-4968-9072-bec16f2366c3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.664780 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-82457da8-2d56-4968-9072-bec16f2366c3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.813813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-82457da8-2d56-4968-9072-bec16f2366c3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:35.826340 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-82457da8-2d56-4968-9072-bec16f2366c3 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.181385 May 10 16:50:35.827153 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 173/353] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:35 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:35.841191 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d0d89ac2-693d-4b87-bd8b-b4ec29891972 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:35.842014 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d0d89ac2-693d-4b87-bd8b-b4ec29891972 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:35.850295 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d0d89ac2-693d-4b87-bd8b-b4ec29891972 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.850754 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d0d89ac2-693d-4b87-bd8b-b4ec29891972 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.851613 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d0d89ac2-693d-4b87-bd8b-b4ec29891972 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.852050 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d0d89ac2-693d-4b87-bd8b-b4ec29891972 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:36.100180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d0d89ac2-693d-4b87-bd8b-b4ec29891972 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:36.118144 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d0d89ac2-693d-4b87-bd8b-b4ec29891972 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:36.120288 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d0d89ac2-693d-4b87-bd8b-b4ec29891972 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:36.121620 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d0d89ac2-693d-4b87-bd8b-b4ec29891972 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.284995 May 10 16:50:36.122414 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 181/354] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:35 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:36.430715 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4857f525-08a6-432e-b268-ada5e9aee8fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:36.431696 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4857f525-08a6-432e-b268-ada5e9aee8fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:36.442390 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4857f525-08a6-432e-b268-ada5e9aee8fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:36.443644 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4857f525-08a6-432e-b268-ada5e9aee8fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:36.445840 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4857f525-08a6-432e-b268-ada5e9aee8fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:36.446539 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4857f525-08a6-432e-b268-ada5e9aee8fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:36.539071 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4857f525-08a6-432e-b268-ada5e9aee8fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:36.547486 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4857f525-08a6-432e-b268-ada5e9aee8fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1306 microversion: 2.1 time: 0.121048 May 10 16:50:36.548640 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 174/355] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:36 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1306 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:36.850972 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8e35789c-9688-4c3a-aaf6-74dbee6664fd tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:36.851589 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8e35789c-9688-4c3a-aaf6-74dbee6664fd tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:36.860677 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8e35789c-9688-4c3a-aaf6-74dbee6664fd tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:36.861266 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8e35789c-9688-4c3a-aaf6-74dbee6664fd tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:36.862156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8e35789c-9688-4c3a-aaf6-74dbee6664fd tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:36.862781 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8e35789c-9688-4c3a-aaf6-74dbee6664fd tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:36.998864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8e35789c-9688-4c3a-aaf6-74dbee6664fd tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:37.007329 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8e35789c-9688-4c3a-aaf6-74dbee6664fd tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.161176 May 10 16:50:37.008117 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 182/356] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:36 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:37.142036 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8fc85379-5310-410e-b589-e3e37708b203 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:37.142682 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8fc85379-5310-410e-b589-e3e37708b203 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:37.149525 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8fc85379-5310-410e-b589-e3e37708b203 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:37.149970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8fc85379-5310-410e-b589-e3e37708b203 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:37.150745 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8fc85379-5310-410e-b589-e3e37708b203 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:37.151180 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8fc85379-5310-410e-b589-e3e37708b203 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:37.295544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8fc85379-5310-410e-b589-e3e37708b203 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:37.303966 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8fc85379-5310-410e-b589-e3e37708b203 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:37.305500 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8fc85379-5310-410e-b589-e3e37708b203 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:37.306796 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8fc85379-5310-410e-b589-e3e37708b203 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1744 microversion: 2.20 time: 0.168586 May 10 16:50:37.307461 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 175/357] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:37 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:37.567356 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7e3a0d10-f58a-4066-a4ed-6cb416897899 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:37.567904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7e3a0d10-f58a-4066-a4ed-6cb416897899 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:37.573996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7e3a0d10-f58a-4066-a4ed-6cb416897899 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:37.574456 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7e3a0d10-f58a-4066-a4ed-6cb416897899 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:37.575239 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7e3a0d10-f58a-4066-a4ed-6cb416897899 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:37.575673 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7e3a0d10-f58a-4066-a4ed-6cb416897899 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:37.638820 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7e3a0d10-f58a-4066-a4ed-6cb416897899 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:37.647099 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7e3a0d10-f58a-4066-a4ed-6cb416897899 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1316 microversion: 2.1 time: 0.084388 May 10 16:50:37.647687 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 183/358] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:37 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1316 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:38.024603 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-fd3451d9-7d6f-4f49-8d0f-be1360b9114f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:38.025216 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-fd3451d9-7d6f-4f49-8d0f-be1360b9114f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:38.031364 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fd3451d9-7d6f-4f49-8d0f-be1360b9114f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.031817 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fd3451d9-7d6f-4f49-8d0f-be1360b9114f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.032624 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fd3451d9-7d6f-4f49-8d0f-be1360b9114f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.033062 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fd3451d9-7d6f-4f49-8d0f-be1360b9114f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.166254 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-fd3451d9-7d6f-4f49-8d0f-be1360b9114f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:38.173925 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-fd3451d9-7d6f-4f49-8d0f-be1360b9114f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.153193 May 10 16:50:38.174525 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 176/359] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:38 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:38.326528 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-97b926f2-fd98-401a-982e-98ad0b3e07ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:38.327152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-97b926f2-fd98-401a-982e-98ad0b3e07ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:38.334081 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97b926f2-fd98-401a-982e-98ad0b3e07ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.334521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97b926f2-fd98-401a-982e-98ad0b3e07ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.335291 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97b926f2-fd98-401a-982e-98ad0b3e07ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.335941 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97b926f2-fd98-401a-982e-98ad0b3e07ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.466972 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-97b926f2-fd98-401a-982e-98ad0b3e07ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:38.475075 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-97b926f2-fd98-401a-982e-98ad0b3e07ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:38.476611 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-97b926f2-fd98-401a-982e-98ad0b3e07ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:38.477782 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-97b926f2-fd98-401a-982e-98ad0b3e07ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1744 microversion: 2.20 time: 0.155234 May 10 16:50:38.478347 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 184/360] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:38 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:38.667206 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-53c2481a-874c-49a4-9397-267713c82765 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:38.667809 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-53c2481a-874c-49a4-9397-267713c82765 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:38.673982 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-53c2481a-874c-49a4-9397-267713c82765 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.674433 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-53c2481a-874c-49a4-9397-267713c82765 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.675215 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-53c2481a-874c-49a4-9397-267713c82765 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.675910 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-53c2481a-874c-49a4-9397-267713c82765 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.739335 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-53c2481a-874c-49a4-9397-267713c82765 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:38.746798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-53c2481a-874c-49a4-9397-267713c82765 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1316 microversion: 2.1 time: 0.083825 May 10 16:50:38.747369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 177/361] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:38 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1316 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:39.191845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-910f5b06-715a-4962-8fe3-80f534e70f6d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:39.192574 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-910f5b06-715a-4962-8fe3-80f534e70f6d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:39.198795 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-910f5b06-715a-4962-8fe3-80f534e70f6d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:39.199237 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-910f5b06-715a-4962-8fe3-80f534e70f6d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:39.200017 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-910f5b06-715a-4962-8fe3-80f534e70f6d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:39.200478 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-910f5b06-715a-4962-8fe3-80f534e70f6d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:39.349088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-910f5b06-715a-4962-8fe3-80f534e70f6d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:39.359200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-910f5b06-715a-4962-8fe3-80f534e70f6d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.171685 May 10 16:50:39.359807 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 185/362] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:39 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:39.495251 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-844d61a0-82d0-4ca5-b4e9-42a7fd51bce7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:39.495849 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-844d61a0-82d0-4ca5-b4e9-42a7fd51bce7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:39.502221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-844d61a0-82d0-4ca5-b4e9-42a7fd51bce7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:39.502674 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-844d61a0-82d0-4ca5-b4e9-42a7fd51bce7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:39.503450 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-844d61a0-82d0-4ca5-b4e9-42a7fd51bce7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:39.503879 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-844d61a0-82d0-4ca5-b4e9-42a7fd51bce7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:39.644890 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-844d61a0-82d0-4ca5-b4e9-42a7fd51bce7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:39.653782 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-844d61a0-82d0-4ca5-b4e9-42a7fd51bce7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:39.655446 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-844d61a0-82d0-4ca5-b4e9-42a7fd51bce7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:39.656910 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-844d61a0-82d0-4ca5-b4e9-42a7fd51bce7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1744 microversion: 2.20 time: 0.165507 May 10 16:50:39.657582 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 178/363] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:39 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:39.764574 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-21d7bde1-764b-4523-99e3-08820f4062fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:39.765175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-21d7bde1-764b-4523-99e3-08820f4062fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:39.771733 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-21d7bde1-764b-4523-99e3-08820f4062fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:39.772179 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-21d7bde1-764b-4523-99e3-08820f4062fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:39.772981 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-21d7bde1-764b-4523-99e3-08820f4062fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:39.773415 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-21d7bde1-764b-4523-99e3-08820f4062fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:39.837336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-21d7bde1-764b-4523-99e3-08820f4062fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:39.844718 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-21d7bde1-764b-4523-99e3-08820f4062fb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1316 microversion: 2.1 time: 0.083870 May 10 16:50:39.845297 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 186/364] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:39 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1316 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:40.376739 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e54058b6-a81d-4869-9ec1-e68b0c5f8e87 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:40.377379 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e54058b6-a81d-4869-9ec1-e68b0c5f8e87 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:40.386649 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e54058b6-a81d-4869-9ec1-e68b0c5f8e87 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.389805 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e54058b6-a81d-4869-9ec1-e68b0c5f8e87 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.391078 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e54058b6-a81d-4869-9ec1-e68b0c5f8e87 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.394319 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e54058b6-a81d-4869-9ec1-e68b0c5f8e87 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.636732 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e54058b6-a81d-4869-9ec1-e68b0c5f8e87 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:40.649455 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e54058b6-a81d-4869-9ec1-e68b0c5f8e87 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.275550 May 10 16:50:40.650673 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 179/365] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:40 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:40.680180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-cbb1c612-c61f-4afa-ba0f-3f399062c8ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:40.680921 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-cbb1c612-c61f-4afa-ba0f-3f399062c8ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:40.689662 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cbb1c612-c61f-4afa-ba0f-3f399062c8ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.691028 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cbb1c612-c61f-4afa-ba0f-3f399062c8ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.692020 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cbb1c612-c61f-4afa-ba0f-3f399062c8ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.692506 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cbb1c612-c61f-4afa-ba0f-3f399062c8ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.868321 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e1f032ff-9176-444e-9032-1b3e402146c6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:40.868918 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e1f032ff-9176-444e-9032-1b3e402146c6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:40.883768 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e1f032ff-9176-444e-9032-1b3e402146c6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.894484 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e1f032ff-9176-444e-9032-1b3e402146c6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.895843 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e1f032ff-9176-444e-9032-1b3e402146c6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.896559 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e1f032ff-9176-444e-9032-1b3e402146c6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.988748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e1f032ff-9176-444e-9032-1b3e402146c6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:41.000608 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e1f032ff-9176-444e-9032-1b3e402146c6 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1304 microversion: 2.1 time: 0.141800 May 10 16:50:41.007571 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 180/366] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:40 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:41.229417 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cbb1c612-c61f-4afa-ba0f-3f399062c8ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:41.239335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cbb1c612-c61f-4afa-ba0f-3f399062c8ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:41.254184 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cbb1c612-c61f-4afa-ba0f-3f399062c8ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:41.255814 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-cbb1c612-c61f-4afa-ba0f-3f399062c8ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.582168 May 10 16:50:41.256983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 187/367] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:40 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:41.668020 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7bbd929d-5213-4c68-8720-a578ac98f949 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:41.668665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7bbd929d-5213-4c68-8720-a578ac98f949 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:41.680057 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7bbd929d-5213-4c68-8720-a578ac98f949 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:41.680437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7bbd929d-5213-4c68-8720-a578ac98f949 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:41.681732 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7bbd929d-5213-4c68-8720-a578ac98f949 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:41.682372 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7bbd929d-5213-4c68-8720-a578ac98f949 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:41.844031 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7bbd929d-5213-4c68-8720-a578ac98f949 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:41.852804 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7bbd929d-5213-4c68-8720-a578ac98f949 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.188444 May 10 16:50:41.858880 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 181/368] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:41 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:42.019434 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ef721f51-4ae5-449d-8e52-e8bbd10ca1fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:42.020829 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ef721f51-4ae5-449d-8e52-e8bbd10ca1fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:42.030143 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ef721f51-4ae5-449d-8e52-e8bbd10ca1fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:42.030696 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ef721f51-4ae5-449d-8e52-e8bbd10ca1fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:42.031582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ef721f51-4ae5-449d-8e52-e8bbd10ca1fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:42.032092 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ef721f51-4ae5-449d-8e52-e8bbd10ca1fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:42.204213 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ef721f51-4ae5-449d-8e52-e8bbd10ca1fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:42.215155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ef721f51-4ae5-449d-8e52-e8bbd10ca1fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1371 microversion: 2.1 time: 0.199950 May 10 16:50:42.216459 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 188/369] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:42 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:42.275961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-498930c3-4828-4d4a-adc9-365fa56278ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:42.277165 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-498930c3-4828-4d4a-adc9-365fa56278ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:42.283844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-498930c3-4828-4d4a-adc9-365fa56278ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:42.285031 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-498930c3-4828-4d4a-adc9-365fa56278ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:42.285399 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-498930c3-4828-4d4a-adc9-365fa56278ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:42.286083 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-498930c3-4828-4d4a-adc9-365fa56278ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:42.451011 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-498930c3-4828-4d4a-adc9-365fa56278ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:42.460897 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-498930c3-4828-4d4a-adc9-365fa56278ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:42.462430 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-498930c3-4828-4d4a-adc9-365fa56278ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:42.463621 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-498930c3-4828-4d4a-adc9-365fa56278ae tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.191769 May 10 16:50:42.464224 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 182/370] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:42 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:50:42.871500 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0dc679c9-09bb-4df0-a145-0673b91cbf6b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:42.872471 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0dc679c9-09bb-4df0-a145-0673b91cbf6b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:42.880794 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0dc679c9-09bb-4df0-a145-0673b91cbf6b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:42.881560 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0dc679c9-09bb-4df0-a145-0673b91cbf6b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:42.882510 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0dc679c9-09bb-4df0-a145-0673b91cbf6b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:42.883106 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0dc679c9-09bb-4df0-a145-0673b91cbf6b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:43.024954 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-0dc679c9-09bb-4df0-a145-0673b91cbf6b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:43.033664 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0dc679c9-09bb-4df0-a145-0673b91cbf6b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.166411 May 10 16:50:43.035799 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 189/371] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:42 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:43.232685 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-1e26ce64-e5c8-4029-bf69-4dd2e3ed3f77 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:43.234085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-1e26ce64-e5c8-4029-bf69-4dd2e3ed3f77 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:43.251977 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1e26ce64-e5c8-4029-bf69-4dd2e3ed3f77 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:43.253084 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1e26ce64-e5c8-4029-bf69-4dd2e3ed3f77 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:43.253957 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1e26ce64-e5c8-4029-bf69-4dd2e3ed3f77 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:43.254470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1e26ce64-e5c8-4029-bf69-4dd2e3ed3f77 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:43.432325 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-1e26ce64-e5c8-4029-bf69-4dd2e3ed3f77 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:43.438012 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-1e26ce64-e5c8-4029-bf69-4dd2e3ed3f77 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1371 microversion: 2.1 time: 0.209295 May 10 16:50:43.439195 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 183/372] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:43 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:43.485155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c8cc052d-f6d5-475b-805a-3b9ee2d087b4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:43.485675 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c8cc052d-f6d5-475b-805a-3b9ee2d087b4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:43.492751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c8cc052d-f6d5-475b-805a-3b9ee2d087b4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:43.493202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c8cc052d-f6d5-475b-805a-3b9ee2d087b4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:43.493992 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c8cc052d-f6d5-475b-805a-3b9ee2d087b4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:43.494896 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c8cc052d-f6d5-475b-805a-3b9ee2d087b4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:43.739933 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c8cc052d-f6d5-475b-805a-3b9ee2d087b4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:43.761216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c8cc052d-f6d5-475b-805a-3b9ee2d087b4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:43.772814 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c8cc052d-f6d5-475b-805a-3b9ee2d087b4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:43.780666 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c8cc052d-f6d5-475b-805a-3b9ee2d087b4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.299001 May 10 16:50:43.792650 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 190/373] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:43 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:44.052645 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-79d968a3-06c6-443f-8409-f3ddef759ec2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:44.053263 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-79d968a3-06c6-443f-8409-f3ddef759ec2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:44.059699 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79d968a3-06c6-443f-8409-f3ddef759ec2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.060567 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79d968a3-06c6-443f-8409-f3ddef759ec2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.061588 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79d968a3-06c6-443f-8409-f3ddef759ec2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.062247 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79d968a3-06c6-443f-8409-f3ddef759ec2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.258813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-79d968a3-06c6-443f-8409-f3ddef759ec2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:44.272347 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-79d968a3-06c6-443f-8409-f3ddef759ec2 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.223817 May 10 16:50:44.273430 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 184/374] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:44 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:44.456057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1775e428-1eea-4b94-8fb9-9eebbcc71e80 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:44.456927 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1775e428-1eea-4b94-8fb9-9eebbcc71e80 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:44.481340 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1775e428-1eea-4b94-8fb9-9eebbcc71e80 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.481676 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1775e428-1eea-4b94-8fb9-9eebbcc71e80 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.483719 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1775e428-1eea-4b94-8fb9-9eebbcc71e80 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.484166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1775e428-1eea-4b94-8fb9-9eebbcc71e80 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.660078 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-37e74f6e-b139-4e0e-8fa0-3c2372dfb4ae req-12c00608-ea1d-4f05-8d66-b1fbb7a693e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061921a1-1ddc-4500-aee0-4cbeb018807f", "tag": "01f7d055-f780-49f6-98a2-68c108a3aa05"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:44.679670 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-37e74f6e-b139-4e0e-8fa0-3c2372dfb4ae req-12c00608-ea1d-4f05-8d66-b1fbb7a693e2 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.680568 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-37e74f6e-b139-4e0e-8fa0-3c2372dfb4ae req-12c00608-ea1d-4f05-8d66-b1fbb7a693e2 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.709306 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-37e74f6e-b139-4e0e-8fa0-3c2372dfb4ae req-12c00608-ea1d-4f05-8d66-b1fbb7a693e2 service nova] Creating event network-changed:01f7d055-f780-49f6-98a2-68c108a3aa05 for instance 061921a1-1ddc-4500-aee0-4cbeb018807f on hv-cinder-83588 May 10 16:50:44.715193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-37e74f6e-b139-4e0e-8fa0-3c2372dfb4ae req-12c00608-ea1d-4f05-8d66-b1fbb7a693e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061764 May 10 16:50:44.717074 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 185/375] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:50:44.810933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-663d532d-2c4d-4859-8d4d-cdc7ddc6abaa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:44.812014 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-663d532d-2c4d-4859-8d4d-cdc7ddc6abaa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:44.825395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-663d532d-2c4d-4859-8d4d-cdc7ddc6abaa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.826507 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-663d532d-2c4d-4859-8d4d-cdc7ddc6abaa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.827761 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-663d532d-2c4d-4859-8d4d-cdc7ddc6abaa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.828505 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-663d532d-2c4d-4859-8d4d-cdc7ddc6abaa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:45.181321 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-663d532d-2c4d-4859-8d4d-cdc7ddc6abaa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:45.191581 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-663d532d-2c4d-4859-8d4d-cdc7ddc6abaa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:45.194480 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-663d532d-2c4d-4859-8d4d-cdc7ddc6abaa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:45.196244 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-663d532d-2c4d-4859-8d4d-cdc7ddc6abaa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.389448 May 10 16:50:45.197514 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 186/376] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:44 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:50:45.211723 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1775e428-1eea-4b94-8fb9-9eebbcc71e80 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:45.211919 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-ce3bee3c-b0de-408c-8973-8953d5d63fa5 req-a916129c-e1e4-4dfb-8961-189fab5f0acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecdb938-f6bb-4133-bbf8-f4b9645ce76a", "name": "network-vif-plugged", "status": "completed", "tag": "c9672453-af7a-47d3-b2cc-46ead0204f1d"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:45.226904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1775e428-1eea-4b94-8fb9-9eebbcc71e80 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1371 microversion: 2.1 time: 0.775710 May 10 16:50:45.229310 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-ce3bee3c-b0de-408c-8973-8953d5d63fa5 req-a916129c-e1e4-4dfb-8961-189fab5f0acb service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:45.235370 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-ce3bee3c-b0de-408c-8973-8953d5d63fa5 req-a916129c-e1e4-4dfb-8961-189fab5f0acb service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:45.241814 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 191/377] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:44 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1371 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:45.277203 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-ce3bee3c-b0de-408c-8973-8953d5d63fa5 req-a916129c-e1e4-4dfb-8961-189fab5f0acb service nova] Creating event network-vif-plugged:c9672453-af7a-47d3-b2cc-46ead0204f1d for instance aecdb938-f6bb-4133-bbf8-f4b9645ce76a on hv-cinder-83588 May 10 16:50:45.293502 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3817dd19-0363-40d9-9413-89baafec7534 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:45.295021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3817dd19-0363-40d9-9413-89baafec7534 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:45.305784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-ce3bee3c-b0de-408c-8973-8953d5d63fa5 req-a916129c-e1e4-4dfb-8961-189fab5f0acb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105324 May 10 16:50:45.310442 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 187/378] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:45.311922 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3817dd19-0363-40d9-9413-89baafec7534 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:45.313270 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3817dd19-0363-40d9-9413-89baafec7534 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:45.314424 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3817dd19-0363-40d9-9413-89baafec7534 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:45.316149 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3817dd19-0363-40d9-9413-89baafec7534 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:45.610325 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3817dd19-0363-40d9-9413-89baafec7534 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:45.623674 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3817dd19-0363-40d9-9413-89baafec7534 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.333862 May 10 16:50:45.624396 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 192/379] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:45 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:46.215918 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3a350ed3-dca0-49bd-8759-4cf2dbe260ba tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:46.217253 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3a350ed3-dca0-49bd-8759-4cf2dbe260ba tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:46.225210 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3a350ed3-dca0-49bd-8759-4cf2dbe260ba tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.226215 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3a350ed3-dca0-49bd-8759-4cf2dbe260ba tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.227271 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3a350ed3-dca0-49bd-8759-4cf2dbe260ba tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.227733 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3a350ed3-dca0-49bd-8759-4cf2dbe260ba tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.250689 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ff100d1d-0b18-487e-9454-963b967709fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:46.252630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ff100d1d-0b18-487e-9454-963b967709fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:46.263165 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ff100d1d-0b18-487e-9454-963b967709fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.265584 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ff100d1d-0b18-487e-9454-963b967709fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.266706 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ff100d1d-0b18-487e-9454-963b967709fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.268623 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ff100d1d-0b18-487e-9454-963b967709fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.437494 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3a350ed3-dca0-49bd-8759-4cf2dbe260ba tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:46.448795 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3a350ed3-dca0-49bd-8759-4cf2dbe260ba tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:46.450317 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3a350ed3-dca0-49bd-8759-4cf2dbe260ba tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:46.451530 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3a350ed3-dca0-49bd-8759-4cf2dbe260ba tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.240254 May 10 16:50:46.452075 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 188/380] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:46 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:46.469685 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ff100d1d-0b18-487e-9454-963b967709fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:46.480011 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ff100d1d-0b18-487e-9454-963b967709fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1371 microversion: 2.1 time: 0.239462 May 10 16:50:46.481912 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 193/381] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:46 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:46.646914 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e6cdf86a-33d9-46e7-940d-9b45e271247b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:46.646914 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e6cdf86a-33d9-46e7-940d-9b45e271247b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:46.650324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e6cdf86a-33d9-46e7-940d-9b45e271247b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.650829 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e6cdf86a-33d9-46e7-940d-9b45e271247b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.654105 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e6cdf86a-33d9-46e7-940d-9b45e271247b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.654543 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e6cdf86a-33d9-46e7-940d-9b45e271247b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.829975 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e6cdf86a-33d9-46e7-940d-9b45e271247b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:46.840377 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e6cdf86a-33d9-46e7-940d-9b45e271247b tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.201147 May 10 16:50:46.841281 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 189/382] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:46 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:47.335198 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-7a339e9b-e148-4c47-9d92-ced858aaed5e req-c36a0432-4c44-466c-a4ad-9e32cf9ceda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6739110-4e68-4993-83ec-7c1503f7b87b", "name": "network-vif-plugged", "status": "completed", "tag": "494f67f0-21ef-40e7-8bd0-9ab88f71dbef"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:47.348714 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-7a339e9b-e148-4c47-9d92-ced858aaed5e req-c36a0432-4c44-466c-a4ad-9e32cf9ceda3 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.349169 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-7a339e9b-e148-4c47-9d92-ced858aaed5e req-c36a0432-4c44-466c-a4ad-9e32cf9ceda3 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.378486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-7a339e9b-e148-4c47-9d92-ced858aaed5e req-c36a0432-4c44-466c-a4ad-9e32cf9ceda3 service nova] Creating event network-vif-plugged:494f67f0-21ef-40e7-8bd0-9ab88f71dbef for instance c6739110-4e68-4993-83ec-7c1503f7b87b on hv-cinder-83588 May 10 16:50:47.385182 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-7a339e9b-e148-4c47-9d92-ced858aaed5e req-c36a0432-4c44-466c-a4ad-9e32cf9ceda3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053913 May 10 16:50:47.386036 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 194/383] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:47.471585 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3b4e1a77-c92d-49f9-815c-a45468803b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:47.473590 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3b4e1a77-c92d-49f9-815c-a45468803b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:47.480591 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3b4e1a77-c92d-49f9-815c-a45468803b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.481786 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3b4e1a77-c92d-49f9-815c-a45468803b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.483018 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3b4e1a77-c92d-49f9-815c-a45468803b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.483701 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3b4e1a77-c92d-49f9-815c-a45468803b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.501393 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-defe31b2-9f64-4ec7-a596-aed07294d650 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:47.503704 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-defe31b2-9f64-4ec7-a596-aed07294d650 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:47.513239 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-defe31b2-9f64-4ec7-a596-aed07294d650 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.519304 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-defe31b2-9f64-4ec7-a596-aed07294d650 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.522009 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-defe31b2-9f64-4ec7-a596-aed07294d650 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.523951 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-defe31b2-9f64-4ec7-a596-aed07294d650 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.731676 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-defe31b2-9f64-4ec7-a596-aed07294d650 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:47.740049 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-defe31b2-9f64-4ec7-a596-aed07294d650 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1371 microversion: 2.1 time: 0.244047 May 10 16:50:47.740969 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 195/384] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:47 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:47.784145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3b4e1a77-c92d-49f9-815c-a45468803b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:47.795207 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3b4e1a77-c92d-49f9-815c-a45468803b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:47.797482 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3b4e1a77-c92d-49f9-815c-a45468803b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:47.798734 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3b4e1a77-c92d-49f9-815c-a45468803b5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.331300 May 10 16:50:47.799438 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 190/385] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:47 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:47.865469 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-09e5aa63-20c3-4107-84af-cfa42dd6b115 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:47.866398 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-09e5aa63-20c3-4107-84af-cfa42dd6b115 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:47.876432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-09e5aa63-20c3-4107-84af-cfa42dd6b115 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.877176 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-09e5aa63-20c3-4107-84af-cfa42dd6b115 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.880159 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-09e5aa63-20c3-4107-84af-cfa42dd6b115 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.880876 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-09e5aa63-20c3-4107-84af-cfa42dd6b115 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:48.216671 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-09e5aa63-20c3-4107-84af-cfa42dd6b115 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:48.236221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-09e5aa63-20c3-4107-84af-cfa42dd6b115 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.381094 May 10 16:50:48.238137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 196/386] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:47 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:48.760582 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-32391cff-a413-49e1-9b25-24ff5cf7d8d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:48.761984 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-32391cff-a413-49e1-9b25-24ff5cf7d8d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:48.773684 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-32391cff-a413-49e1-9b25-24ff5cf7d8d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:48.774695 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-32391cff-a413-49e1-9b25-24ff5cf7d8d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:48.775687 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-32391cff-a413-49e1-9b25-24ff5cf7d8d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:48.778765 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-32391cff-a413-49e1-9b25-24ff5cf7d8d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:48.832004 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-956104aa-6e62-4fcf-88ad-a321ffd0dcc2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:48.833282 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-956104aa-6e62-4fcf-88ad-a321ffd0dcc2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:48.841242 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-956104aa-6e62-4fcf-88ad-a321ffd0dcc2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:48.842402 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-956104aa-6e62-4fcf-88ad-a321ffd0dcc2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:48.843423 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-956104aa-6e62-4fcf-88ad-a321ffd0dcc2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:48.844083 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-956104aa-6e62-4fcf-88ad-a321ffd0dcc2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:49.107085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-32391cff-a413-49e1-9b25-24ff5cf7d8d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:49.116053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-32391cff-a413-49e1-9b25-24ff5cf7d8d1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1371 microversion: 2.1 time: 0.359383 May 10 16:50:49.116667 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 191/387] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:48 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:49.152243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-956104aa-6e62-4fcf-88ad-a321ffd0dcc2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:49.167540 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-956104aa-6e62-4fcf-88ad-a321ffd0dcc2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:49.170075 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-956104aa-6e62-4fcf-88ad-a321ffd0dcc2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:49.171325 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-956104aa-6e62-4fcf-88ad-a321ffd0dcc2 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.344567 May 10 16:50:49.172051 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 197/388] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:48 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:49.278708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ad8def48-6f4a-4020-95d6-dbc2a0c0dcda tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:49.280855 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ad8def48-6f4a-4020-95d6-dbc2a0c0dcda tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:49.307112 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ad8def48-6f4a-4020-95d6-dbc2a0c0dcda tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:49.310922 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ad8def48-6f4a-4020-95d6-dbc2a0c0dcda tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:49.311868 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ad8def48-6f4a-4020-95d6-dbc2a0c0dcda tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:49.312513 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ad8def48-6f4a-4020-95d6-dbc2a0c0dcda tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:49.609477 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ad8def48-6f4a-4020-95d6-dbc2a0c0dcda tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:49.618766 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ad8def48-6f4a-4020-95d6-dbc2a0c0dcda tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.368930 May 10 16:50:49.619957 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 192/389] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:49 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:50.135407 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2eda5583-bd79-42b6-8124-d076fb6002f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:50.136829 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2eda5583-bd79-42b6-8124-d076fb6002f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:50.162501 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2eda5583-bd79-42b6-8124-d076fb6002f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.164746 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2eda5583-bd79-42b6-8124-d076fb6002f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.167181 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2eda5583-bd79-42b6-8124-d076fb6002f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.169300 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2eda5583-bd79-42b6-8124-d076fb6002f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.190777 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0149e103-e151-4c14-ad03-224b5705be76 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:50.192085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0149e103-e151-4c14-ad03-224b5705be76 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:50.210006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0149e103-e151-4c14-ad03-224b5705be76 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.210378 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0149e103-e151-4c14-ad03-224b5705be76 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.211177 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0149e103-e151-4c14-ad03-224b5705be76 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.211621 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0149e103-e151-4c14-ad03-224b5705be76 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.519762 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0149e103-e151-4c14-ad03-224b5705be76 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:50.531802 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0149e103-e151-4c14-ad03-224b5705be76 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:50.533356 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0149e103-e151-4c14-ad03-224b5705be76 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:50.536085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0149e103-e151-4c14-ad03-224b5705be76 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.349021 May 10 16:50:50.536680 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 193/390] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:50 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:50:50.643717 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-40b249b0-b7de-4c08-a1ef-a12a602d9ae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:50.644193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-40b249b0-b7de-4c08-a1ef-a12a602d9ae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:50.666388 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-40b249b0-b7de-4c08-a1ef-a12a602d9ae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.667047 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-40b249b0-b7de-4c08-a1ef-a12a602d9ae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.668012 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-40b249b0-b7de-4c08-a1ef-a12a602d9ae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.668489 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-40b249b0-b7de-4c08-a1ef-a12a602d9ae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.718390 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2eda5583-bd79-42b6-8124-d076fb6002f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:50.730296 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2eda5583-bd79-42b6-8124-d076fb6002f2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1371 microversion: 2.1 time: 0.599339 May 10 16:50:50.733841 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 198/391] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:50 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1371 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:50.893983 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-40b249b0-b7de-4c08-a1ef-a12a602d9ae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:50.915942 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-40b249b0-b7de-4c08-a1ef-a12a602d9ae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1319 microversion: 2.1 time: 0.277969 May 10 16:50:50.922674 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 194/392] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:50 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:51.558163 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2520d4d4-3259-4028-ab00-1e360fdbe966 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:51.558787 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2520d4d4-3259-4028-ab00-1e360fdbe966 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:51.570439 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2520d4d4-3259-4028-ab00-1e360fdbe966 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:51.579852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2520d4d4-3259-4028-ab00-1e360fdbe966 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:51.581855 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2520d4d4-3259-4028-ab00-1e360fdbe966 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:51.590165 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2520d4d4-3259-4028-ab00-1e360fdbe966 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:51.754015 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9dddc187-9d24-4ff3-877e-797d305af6ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:51.754894 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9dddc187-9d24-4ff3-877e-797d305af6ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:51.764974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9dddc187-9d24-4ff3-877e-797d305af6ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:51.765731 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9dddc187-9d24-4ff3-877e-797d305af6ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:51.766679 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9dddc187-9d24-4ff3-877e-797d305af6ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:51.767272 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9dddc187-9d24-4ff3-877e-797d305af6ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:51.911550 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2520d4d4-3259-4028-ab00-1e360fdbe966 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:51.920807 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2520d4d4-3259-4028-ab00-1e360fdbe966 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:51.922317 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2520d4d4-3259-4028-ab00-1e360fdbe966 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:51.928196 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2520d4d4-3259-4028-ab00-1e360fdbe966 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.373996 May 10 16:50:51.933624 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 199/393] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:51 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:51.939993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-85bce23e-9d80-4094-b75d-bd60703e7675 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:51.945639 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-85bce23e-9d80-4094-b75d-bd60703e7675 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:51.962531 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-85bce23e-9d80-4094-b75d-bd60703e7675 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:51.964707 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-85bce23e-9d80-4094-b75d-bd60703e7675 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:51.972888 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-85bce23e-9d80-4094-b75d-bd60703e7675 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:51.973520 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-85bce23e-9d80-4094-b75d-bd60703e7675 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.025443 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9dddc187-9d24-4ff3-877e-797d305af6ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:52.034582 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9dddc187-9d24-4ff3-877e-797d305af6ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1371 microversion: 2.1 time: 0.285157 May 10 16:50:52.045465 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 195/394] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:51 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:52.449477 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-85bce23e-9d80-4094-b75d-bd60703e7675 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:52.461913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-85bce23e-9d80-4094-b75d-bd60703e7675 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1507 microversion: 2.1 time: 0.526842 May 10 16:50:52.464087 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 200/395] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:51 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1507 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:52.890994 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-8c61c68c-699d-47fb-b130-db28b25c4ee4 req-23ea5645-ce7d-492c-ba6e-eed7f0d41ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061921a1-1ddc-4500-aee0-4cbeb018807f", "name": "network-vif-plugged", "status": "completed", "tag": "01f7d055-f780-49f6-98a2-68c108a3aa05"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:52.916057 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-8c61c68c-699d-47fb-b130-db28b25c4ee4 req-23ea5645-ce7d-492c-ba6e-eed7f0d41ef4 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.918161 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-8c61c68c-699d-47fb-b130-db28b25c4ee4 req-23ea5645-ce7d-492c-ba6e-eed7f0d41ef4 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.965560 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-dfa57287-87ac-4dec-ae94-c58e67c28fe9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:52.970115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-dfa57287-87ac-4dec-ae94-c58e67c28fe9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:52.979113 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-8c61c68c-699d-47fb-b130-db28b25c4ee4 req-23ea5645-ce7d-492c-ba6e-eed7f0d41ef4 service nova] Creating event network-vif-plugged:01f7d055-f780-49f6-98a2-68c108a3aa05 for instance 061921a1-1ddc-4500-aee0-4cbeb018807f on hv-cinder-83588 May 10 16:50:52.990197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dfa57287-87ac-4dec-ae94-c58e67c28fe9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.991159 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dfa57287-87ac-4dec-ae94-c58e67c28fe9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.993257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-8c61c68c-699d-47fb-b130-db28b25c4ee4 req-23ea5645-ce7d-492c-ba6e-eed7f0d41ef4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108536 May 10 16:50:52.994345 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dfa57287-87ac-4dec-ae94-c58e67c28fe9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.995222 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dfa57287-87ac-4dec-ae94-c58e67c28fe9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.995933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 196/396] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:53.055114 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3bc411d3-4573-4edb-8757-07e432b13f67 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:53.056122 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3bc411d3-4573-4edb-8757-07e432b13f67 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:53.072687 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3bc411d3-4573-4edb-8757-07e432b13f67 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:53.073951 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3bc411d3-4573-4edb-8757-07e432b13f67 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:53.075038 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3bc411d3-4573-4edb-8757-07e432b13f67 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:53.075695 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3bc411d3-4573-4edb-8757-07e432b13f67 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:53.422934 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3bc411d3-4573-4edb-8757-07e432b13f67 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:53.444254 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3bc411d3-4573-4edb-8757-07e432b13f67 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1371 microversion: 2.1 time: 0.394256 May 10 16:50:53.451403 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 197/397] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:53 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:53.657307 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-dfa57287-87ac-4dec-ae94-c58e67c28fe9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:53.665664 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-dfa57287-87ac-4dec-ae94-c58e67c28fe9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:53.667648 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-dfa57287-87ac-4dec-ae94-c58e67c28fe9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:53.669248 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-dfa57287-87ac-4dec-ae94-c58e67c28fe9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.718211 May 10 16:50:53.670342 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 201/398] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:52 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:54.467376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-51895cc2-e3cf-4941-a741-a5152a0d3c18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:54.468461 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-51895cc2-e3cf-4941-a741-a5152a0d3c18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:54.485861 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-51895cc2-e3cf-4941-a741-a5152a0d3c18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:54.489427 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-51895cc2-e3cf-4941-a741-a5152a0d3c18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.490675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-51895cc2-e3cf-4941-a741-a5152a0d3c18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:54.493549 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-51895cc2-e3cf-4941-a741-a5152a0d3c18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.692028 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f8f670da-6f40-403e-b846-219095f3ba04 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:54.692660 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f8f670da-6f40-403e-b846-219095f3ba04 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:54.710829 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f8f670da-6f40-403e-b846-219095f3ba04 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:54.713609 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f8f670da-6f40-403e-b846-219095f3ba04 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.714633 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f8f670da-6f40-403e-b846-219095f3ba04 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:54.714905 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f8f670da-6f40-403e-b846-219095f3ba04 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.833848 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-51895cc2-e3cf-4941-a741-a5152a0d3c18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:54.845612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-51895cc2-e3cf-4941-a741-a5152a0d3c18 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1371 microversion: 2.1 time: 0.382452 May 10 16:50:54.847928 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 198/399] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:54 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:55.300886 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f8f670da-6f40-403e-b846-219095f3ba04 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:55.311888 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f8f670da-6f40-403e-b846-219095f3ba04 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:55.313834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f8f670da-6f40-403e-b846-219095f3ba04 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:55.316394 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f8f670da-6f40-403e-b846-219095f3ba04 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1739 microversion: 2.20 time: 0.631343 May 10 16:50:55.317556 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 202/400] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:54 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1739 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:55.863828 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-338cd32e-dba3-4e85-93d7-da52fc48832d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:55.864692 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-338cd32e-dba3-4e85-93d7-da52fc48832d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:55.872723 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-338cd32e-dba3-4e85-93d7-da52fc48832d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:55.873255 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-338cd32e-dba3-4e85-93d7-da52fc48832d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:55.875424 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-338cd32e-dba3-4e85-93d7-da52fc48832d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:55.875424 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-338cd32e-dba3-4e85-93d7-da52fc48832d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.056753 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-338cd32e-dba3-4e85-93d7-da52fc48832d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:56.064429 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-338cd32e-dba3-4e85-93d7-da52fc48832d tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1566 microversion: 2.1 time: 0.205376 May 10 16:50:56.066446 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 199/401] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:50:55 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:56.087578 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0eb5f6ce-363a-4aac-bf9d-dba746dd8e28 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:56.088826 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0eb5f6ce-363a-4aac-bf9d-dba746dd8e28 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:56.097839 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0eb5f6ce-363a-4aac-bf9d-dba746dd8e28 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.098394 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0eb5f6ce-363a-4aac-bf9d-dba746dd8e28 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.099304 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0eb5f6ce-363a-4aac-bf9d-dba746dd8e28 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.099949 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0eb5f6ce-363a-4aac-bf9d-dba746dd8e28 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.275494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0eb5f6ce-363a-4aac-bf9d-dba746dd8e28 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192603 May 10 16:50:56.276101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 203/402] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 10 16:50:56 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:56.337423 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-569ab50c-7e3a-429d-8a4a-01a188c55d60 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:56.342432 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-569ab50c-7e3a-429d-8a4a-01a188c55d60 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:56.355124 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-569ab50c-7e3a-429d-8a4a-01a188c55d60 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.355946 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-569ab50c-7e3a-429d-8a4a-01a188c55d60 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.357030 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-569ab50c-7e3a-429d-8a4a-01a188c55d60 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.357688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-569ab50c-7e3a-429d-8a4a-01a188c55d60 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.681159 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-569ab50c-7e3a-429d-8a4a-01a188c55d60 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:56.702597 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-569ab50c-7e3a-429d-8a4a-01a188c55d60 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:56.707166 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-569ab50c-7e3a-429d-8a4a-01a188c55d60 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:56.708684 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-569ab50c-7e3a-429d-8a4a-01a188c55d60 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1721 microversion: 2.20 time: 0.376477 May 10 16:50:56.717367 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 200/403] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:56 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1721 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:57.728591 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b3803838-2a5d-46dc-921d-383a6869fd0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:57.729201 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b3803838-2a5d-46dc-921d-383a6869fd0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:57.736193 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3803838-2a5d-46dc-921d-383a6869fd0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:57.736764 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3803838-2a5d-46dc-921d-383a6869fd0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:57.737973 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3803838-2a5d-46dc-921d-383a6869fd0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:57.738413 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3803838-2a5d-46dc-921d-383a6869fd0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:57.932891 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b3803838-2a5d-46dc-921d-383a6869fd0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:57.943806 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b3803838-2a5d-46dc-921d-383a6869fd0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:57.947936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b3803838-2a5d-46dc-921d-383a6869fd0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:57.949819 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b3803838-2a5d-46dc-921d-383a6869fd0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1721 microversion: 2.20 time: 0.226277 May 10 16:50:57.950792 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 204/404] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:57 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:58.282012 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-0d3b9bf3-d174-4320-805b-d695a5946ccc req-08d1df5d-9ca5-41c0-be8f-162716e63446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061921a1-1ddc-4500-aee0-4cbeb018807f", "tag": "01f7d055-f780-49f6-98a2-68c108a3aa05"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:58.302940 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-0d3b9bf3-d174-4320-805b-d695a5946ccc req-08d1df5d-9ca5-41c0-be8f-162716e63446 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:58.303388 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-0d3b9bf3-d174-4320-805b-d695a5946ccc req-08d1df5d-9ca5-41c0-be8f-162716e63446 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:58.326610 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-0d3b9bf3-d174-4320-805b-d695a5946ccc req-08d1df5d-9ca5-41c0-be8f-162716e63446 service nova] Creating event network-changed:01f7d055-f780-49f6-98a2-68c108a3aa05 for instance 061921a1-1ddc-4500-aee0-4cbeb018807f on hv-cinder-83588 May 10 16:50:58.332690 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-0d3b9bf3-d174-4320-805b-d695a5946ccc req-08d1df5d-9ca5-41c0-be8f-162716e63446 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054513 May 10 16:50:58.334105 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 201/405] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:58.969031 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-276dda03-be60-4009-b532-2e634cb7a208 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:58.969641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-276dda03-be60-4009-b532-2e634cb7a208 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:58.982454 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-276dda03-be60-4009-b532-2e634cb7a208 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:58.982911 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-276dda03-be60-4009-b532-2e634cb7a208 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:58.983705 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-276dda03-be60-4009-b532-2e634cb7a208 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:58.984145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-276dda03-be60-4009-b532-2e634cb7a208 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:59.263216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-276dda03-be60-4009-b532-2e634cb7a208 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:59.282576 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-276dda03-be60-4009-b532-2e634cb7a208 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:59.290017 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-276dda03-be60-4009-b532-2e634cb7a208 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:59.314306 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-276dda03-be60-4009-b532-2e634cb7a208 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1721 microversion: 2.20 time: 0.349073 May 10 16:50:59.319860 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 205/406] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:50:58 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1721 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:00.340162 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-33bdc6cb-6ee6-464f-99f1-e0804b914864 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:00.341068 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-33bdc6cb-6ee6-464f-99f1-e0804b914864 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:00.365153 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-33bdc6cb-6ee6-464f-99f1-e0804b914864 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.376213 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-33bdc6cb-6ee6-464f-99f1-e0804b914864 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.382878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-33bdc6cb-6ee6-464f-99f1-e0804b914864 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.382878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-33bdc6cb-6ee6-464f-99f1-e0804b914864 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.598007 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-7849f317-270e-4ba8-b638-5b91abcc6a90 req-ecea2447-a8f7-4aec-a2db-eb40ab29c8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6739110-4e68-4993-83ec-7c1503f7b87b", "name": "network-vif-unplugged", "status": "completed", "tag": "494f67f0-21ef-40e7-8bd0-9ab88f71dbef"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:00.645479 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-7849f317-270e-4ba8-b638-5b91abcc6a90 req-ecea2447-a8f7-4aec-a2db-eb40ab29c8db service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.646343 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-7849f317-270e-4ba8-b638-5b91abcc6a90 req-ecea2447-a8f7-4aec-a2db-eb40ab29c8db service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.700771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-7849f317-270e-4ba8-b638-5b91abcc6a90 req-ecea2447-a8f7-4aec-a2db-eb40ab29c8db service nova] Creating event network-vif-unplugged:494f67f0-21ef-40e7-8bd0-9ab88f71dbef for instance c6739110-4e68-4993-83ec-7c1503f7b87b on hv-cinder-83588 May 10 16:51:00.714797 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-7849f317-270e-4ba8-b638-5b91abcc6a90 req-ecea2447-a8f7-4aec-a2db-eb40ab29c8db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121624 May 10 16:51:00.716170 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 206/407] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:51:00.817423 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-33bdc6cb-6ee6-464f-99f1-e0804b914864 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:00.839402 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-33bdc6cb-6ee6-464f-99f1-e0804b914864 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:00.842460 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-33bdc6cb-6ee6-464f-99f1-e0804b914864 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:00.844193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-33bdc6cb-6ee6-464f-99f1-e0804b914864 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1724 microversion: 2.20 time: 0.510230 May 10 16:51:00.858988 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 202/408] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:00 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1724 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:00.866744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d058bf46-5c80-4ec8-9d82-c7a406bb7d87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27e4a353-dab6-42db-b6f1-5d6622ab3121"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:00.868728 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d058bf46-5c80-4ec8-9d82-c7a406bb7d87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:00.878985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d058bf46-5c80-4ec8-9d82-c7a406bb7d87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.879962 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d058bf46-5c80-4ec8-9d82-c7a406bb7d87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.881033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d058bf46-5c80-4ec8-9d82-c7a406bb7d87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.881462 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d058bf46-5c80-4ec8-9d82-c7a406bb7d87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:01.466830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d058bf46-5c80-4ec8-9d82-c7a406bb7d87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "POST /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.604313 May 10 16:51:01.467692 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 207/409] 10.222.0.48 () {62 vars in 1363 bytes} [Tue May 10 16:51:00 2022] POST /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments => generated 188 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:51:01.732946 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2d9fdcf8-ec6f-41d6-90b5-e7744d4643bc tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:01.733717 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2d9fdcf8-ec6f-41d6-90b5-e7744d4643bc tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:01.741210 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d9fdcf8-ec6f-41d6-90b5-e7744d4643bc tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:01.741657 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d9fdcf8-ec6f-41d6-90b5-e7744d4643bc tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:01.742442 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d9fdcf8-ec6f-41d6-90b5-e7744d4643bc tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:01.743402 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d9fdcf8-ec6f-41d6-90b5-e7744d4643bc tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:01.896952 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2d9fdcf8-ec6f-41d6-90b5-e7744d4643bc tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "POST /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/action" status: 202 len: 0 microversion: 2.20 time: 0.167900 May 10 16:51:01.911446 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-419c6162-c711-4a96-b3f5-f40d5ccc4975 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:01.912128 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-419c6162-c711-4a96-b3f5-f40d5ccc4975 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:01.926482 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 203/410] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 10 16:51:01 2022] POST /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 16:51:01.951179 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-419c6162-c711-4a96-b3f5-f40d5ccc4975 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:01.952471 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-419c6162-c711-4a96-b3f5-f40d5ccc4975 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:01.953541 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-419c6162-c711-4a96-b3f5-f40d5ccc4975 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:01.954629 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-419c6162-c711-4a96-b3f5-f40d5ccc4975 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:02.273227 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-419c6162-c711-4a96-b3f5-f40d5ccc4975 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:02.281339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-419c6162-c711-4a96-b3f5-f40d5ccc4975 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:02.282899 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-419c6162-c711-4a96-b3f5-f40d5ccc4975 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:02.284759 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-419c6162-c711-4a96-b3f5-f40d5ccc4975 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1750 microversion: 2.20 time: 0.378257 May 10 16:51:02.285934 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 208/411] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:01 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1750 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:03.304490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-012149dd-04a2-4f4f-80ea-b21921fb5fc8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:03.305108 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-012149dd-04a2-4f4f-80ea-b21921fb5fc8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:03.316533 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-012149dd-04a2-4f4f-80ea-b21921fb5fc8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:03.317313 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-012149dd-04a2-4f4f-80ea-b21921fb5fc8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:03.318516 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-012149dd-04a2-4f4f-80ea-b21921fb5fc8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:03.319205 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-012149dd-04a2-4f4f-80ea-b21921fb5fc8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:03.562434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-012149dd-04a2-4f4f-80ea-b21921fb5fc8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:03.578240 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-012149dd-04a2-4f4f-80ea-b21921fb5fc8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:03.581777 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-012149dd-04a2-4f4f-80ea-b21921fb5fc8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:03.583247 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-012149dd-04a2-4f4f-80ea-b21921fb5fc8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1750 microversion: 2.20 time: 0.283284 May 10 16:51:03.584449 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 204/412] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:03 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1750 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:04.605641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6b711565-66f2-4911-aa23-37fa583c9c67 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:04.606925 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6b711565-66f2-4911-aa23-37fa583c9c67 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:04.614183 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6b711565-66f2-4911-aa23-37fa583c9c67 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:04.615002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6b711565-66f2-4911-aa23-37fa583c9c67 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:04.615798 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6b711565-66f2-4911-aa23-37fa583c9c67 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:04.616244 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6b711565-66f2-4911-aa23-37fa583c9c67 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:04.883919 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6b711565-66f2-4911-aa23-37fa583c9c67 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:04.907418 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6b711565-66f2-4911-aa23-37fa583c9c67 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:04.912945 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6b711565-66f2-4911-aa23-37fa583c9c67 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:04.915306 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6b711565-66f2-4911-aa23-37fa583c9c67 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.316903 May 10 16:51:04.921912 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 209/413] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:04 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:05.943842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-143544f8-54f1-4cd9-ac63-7184232b5458 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:05.944466 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-143544f8-54f1-4cd9-ac63-7184232b5458 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:05.962824 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-143544f8-54f1-4cd9-ac63-7184232b5458 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:05.963291 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-143544f8-54f1-4cd9-ac63-7184232b5458 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:05.964087 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-143544f8-54f1-4cd9-ac63-7184232b5458 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:05.964562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-143544f8-54f1-4cd9-ac63-7184232b5458 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:06.138106 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-143544f8-54f1-4cd9-ac63-7184232b5458 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:06.148717 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-143544f8-54f1-4cd9-ac63-7184232b5458 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:06.150951 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-143544f8-54f1-4cd9-ac63-7184232b5458 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:06.152451 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-143544f8-54f1-4cd9-ac63-7184232b5458 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.213392 May 10 16:51:06.153504 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 205/414] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:05 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:07.171699 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-cc90cb1d-86e6-4c6d-af78-ad8428e6cdfe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:07.172721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-cc90cb1d-86e6-4c6d-af78-ad8428e6cdfe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:07.199062 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cc90cb1d-86e6-4c6d-af78-ad8428e6cdfe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.199446 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cc90cb1d-86e6-4c6d-af78-ad8428e6cdfe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.200239 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cc90cb1d-86e6-4c6d-af78-ad8428e6cdfe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.200885 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cc90cb1d-86e6-4c6d-af78-ad8428e6cdfe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.506089 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cc90cb1d-86e6-4c6d-af78-ad8428e6cdfe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:07.529760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cc90cb1d-86e6-4c6d-af78-ad8428e6cdfe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:07.531883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cc90cb1d-86e6-4c6d-af78-ad8428e6cdfe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:07.533877 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-cc90cb1d-86e6-4c6d-af78-ad8428e6cdfe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.366071 May 10 16:51:07.540846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 210/415] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:07 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:08.553741 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-abed4b4a-a085-43b6-b98e-8c331c2051ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:08.555196 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-abed4b4a-a085-43b6-b98e-8c331c2051ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:08.569425 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-abed4b4a-a085-43b6-b98e-8c331c2051ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:08.570179 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-abed4b4a-a085-43b6-b98e-8c331c2051ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:08.571163 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-abed4b4a-a085-43b6-b98e-8c331c2051ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:08.576619 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-abed4b4a-a085-43b6-b98e-8c331c2051ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:08.829557 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-abed4b4a-a085-43b6-b98e-8c331c2051ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:08.849705 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-abed4b4a-a085-43b6-b98e-8c331c2051ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:08.851664 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-abed4b4a-a085-43b6-b98e-8c331c2051ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:08.853866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-abed4b4a-a085-43b6-b98e-8c331c2051ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.305485 May 10 16:51:08.854994 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 206/416] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:08 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:09.898705 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3329a982-366b-4a34-b2cc-6279bcd3d2d5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:09.900214 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3329a982-366b-4a34-b2cc-6279bcd3d2d5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:09.907488 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3329a982-366b-4a34-b2cc-6279bcd3d2d5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:09.908944 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3329a982-366b-4a34-b2cc-6279bcd3d2d5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:09.909934 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3329a982-366b-4a34-b2cc-6279bcd3d2d5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:09.910520 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3329a982-366b-4a34-b2cc-6279bcd3d2d5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:10.217361 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3329a982-366b-4a34-b2cc-6279bcd3d2d5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:10.229023 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3329a982-366b-4a34-b2cc-6279bcd3d2d5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:10.230838 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3329a982-366b-4a34-b2cc-6279bcd3d2d5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:10.232262 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3329a982-366b-4a34-b2cc-6279bcd3d2d5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.337504 May 10 16:51:10.233441 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 211/417] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:09 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:11.259365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2128c259-70ca-4ea2-b5f4-9331efa8b30e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:11.260780 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2128c259-70ca-4ea2-b5f4-9331efa8b30e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:11.272870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2128c259-70ca-4ea2-b5f4-9331efa8b30e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:11.274124 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2128c259-70ca-4ea2-b5f4-9331efa8b30e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:11.275215 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2128c259-70ca-4ea2-b5f4-9331efa8b30e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:11.275811 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2128c259-70ca-4ea2-b5f4-9331efa8b30e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:11.513913 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2128c259-70ca-4ea2-b5f4-9331efa8b30e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:11.533288 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2128c259-70ca-4ea2-b5f4-9331efa8b30e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:11.539140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2128c259-70ca-4ea2-b5f4-9331efa8b30e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:11.551480 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2128c259-70ca-4ea2-b5f4-9331efa8b30e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.295468 May 10 16:51:11.552311 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 207/418] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:11 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:12.579063 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-050a0c6b-b41d-4713-801e-e487024d9d44 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:12.581268 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-050a0c6b-b41d-4713-801e-e487024d9d44 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:12.592199 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-050a0c6b-b41d-4713-801e-e487024d9d44 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:12.593021 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-050a0c6b-b41d-4713-801e-e487024d9d44 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:12.594302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-050a0c6b-b41d-4713-801e-e487024d9d44 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:12.594971 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-050a0c6b-b41d-4713-801e-e487024d9d44 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:12.881125 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-050a0c6b-b41d-4713-801e-e487024d9d44 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:12.890283 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-050a0c6b-b41d-4713-801e-e487024d9d44 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:12.891816 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-050a0c6b-b41d-4713-801e-e487024d9d44 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:12.894347 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-050a0c6b-b41d-4713-801e-e487024d9d44 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.327504 May 10 16:51:12.894947 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 212/419] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:12 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:13.917154 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-45a0dfe1-22ea-4c33-bc93-42ddecae8525 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:13.918624 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-45a0dfe1-22ea-4c33-bc93-42ddecae8525 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:13.924984 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-45a0dfe1-22ea-4c33-bc93-42ddecae8525 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:13.925681 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-45a0dfe1-22ea-4c33-bc93-42ddecae8525 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:13.926450 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-45a0dfe1-22ea-4c33-bc93-42ddecae8525 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:13.927064 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-45a0dfe1-22ea-4c33-bc93-42ddecae8525 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:14.141175 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-45a0dfe1-22ea-4c33-bc93-42ddecae8525 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:14.153735 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-45a0dfe1-22ea-4c33-bc93-42ddecae8525 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:14.155383 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-45a0dfe1-22ea-4c33-bc93-42ddecae8525 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:14.156698 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-45a0dfe1-22ea-4c33-bc93-42ddecae8525 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.246664 May 10 16:51:14.157354 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 208/420] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:13 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:14.819386 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8fe8ed0b-c7b3-4800-9ed9-38599f84f717 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Action: 'create', calling method: .version_select at 0x7f5fb651aaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-658794165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPky2ceQ3DI99FcS2P3PhAirpCx8vmLNZyiZ4Fw+An9pdIRwipBrIAFYQ2uyQHpVdVAyx0Gbr7sgc/fC2eTEzZXN59g70kVZFaniVzTprQXaF/FnbYUMSI1ySB/hIODPqQ=="}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:14.835780 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-8fe8ed0b-c7b3-4800-9ed9-38599f84f717 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Getting quotas for project ad2249e85fd741258c91142e19edc714. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:51:14.840369 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-8fe8ed0b-c7b3-4800-9ed9-38599f84f717 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Getting quotas for user a0aa3cf87a4c4c67a5c8a458f81ef61c and project ad2249e85fd741258c91142e19edc714. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:51:14.869108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8fe8ed0b-c7b3-4800-9ed9-38599f84f717 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053394 May 10 16:51:14.870057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 213/421] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 10 16:51:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:51:14.924472 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-504951403", "imageRef": "4a1830d7-787e-497e-8b81-f2f9b83bcec2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-658794165", "networks": [{"uuid": "c651f71d-58b1-4ad6-afef-e7eaac16708e"}]}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:14.974997 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] validate_networks() for [('c651f71d-58b1-4ad6-afef-e7eaac16708e', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:51:15.176683 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f779e32b-d5e1-44fb-817f-12552b1b12ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:15.177713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f779e32b-d5e1-44fb-817f-12552b1b12ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:15.184011 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f779e32b-d5e1-44fb-817f-12552b1b12ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:15.184834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f779e32b-d5e1-44fb-817f-12552b1b12ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:15.185872 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f779e32b-d5e1-44fb-817f-12552b1b12ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:15.186419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f779e32b-d5e1-44fb-817f-12552b1b12ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:15.346238 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f779e32b-d5e1-44fb-817f-12552b1b12ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:15.356194 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f779e32b-d5e1-44fb-817f-12552b1b12ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:15.357893 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f779e32b-d5e1-44fb-817f-12552b1b12ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:15.359254 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f779e32b-d5e1-44fb-817f-12552b1b12ef tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.187426 May 10 16:51:15.371235 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 214/422] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:15 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:15.423015 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:51:15.428470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:51:15.429363 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:51:15.429858 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:51:15.430415 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:51:15.440781 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:15.441356 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:15.442902 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:15.443410 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:15.461838 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Getting quotas for project ad2249e85fd741258c91142e19edc714. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:51:15.466025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Getting quotas for user a0aa3cf87a4c4c67a5c8a458f81ef61c and project ad2249e85fd741258c91142e19edc714. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:51:15.481862 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:51:15.484100 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4a1830d7-787e-497e-8b81-f2f9b83bcec2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:51:15.532727 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ce68bf9a-7186-492a-9daa-ee1e7dfd1fe6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611991 May 10 16:51:15.533692 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 209/423] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:51:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:51:15.558486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f77cb611-7511-4c88-844c-5e4d9225e4de tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:15.559828 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f77cb611-7511-4c88-844c-5e4d9225e4de tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:15.655171 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f77cb611-7511-4c88-844c-5e4d9225e4de tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:15.664590 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f77cb611-7511-4c88-844c-5e4d9225e4de tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1257 microversion: 2.1 time: 0.119982 May 10 16:51:15.676853 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 215/424] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:15 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1257 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:16.382401 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-89f1124b-fa67-4c4e-8e0e-0fa0bdafafb0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:16.383857 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-89f1124b-fa67-4c4e-8e0e-0fa0bdafafb0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:16.391371 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-89f1124b-fa67-4c4e-8e0e-0fa0bdafafb0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:16.391815 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-89f1124b-fa67-4c4e-8e0e-0fa0bdafafb0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:16.393945 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-89f1124b-fa67-4c4e-8e0e-0fa0bdafafb0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:16.394581 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-89f1124b-fa67-4c4e-8e0e-0fa0bdafafb0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:16.539506 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-89f1124b-fa67-4c4e-8e0e-0fa0bdafafb0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:16.548072 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-89f1124b-fa67-4c4e-8e0e-0fa0bdafafb0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:16.550080 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-89f1124b-fa67-4c4e-8e0e-0fa0bdafafb0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:16.551582 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-89f1124b-fa67-4c4e-8e0e-0fa0bdafafb0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.176474 May 10 16:51:16.552152 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 210/425] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:16 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:16.684291 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e5d9e1cc-f841-4914-9a77-cbeb9b055aad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:16.684906 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e5d9e1cc-f841-4914-9a77-cbeb9b055aad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:16.693377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e5d9e1cc-f841-4914-9a77-cbeb9b055aad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:16.693830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e5d9e1cc-f841-4914-9a77-cbeb9b055aad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:16.694616 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e5d9e1cc-f841-4914-9a77-cbeb9b055aad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:16.695058 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e5d9e1cc-f841-4914-9a77-cbeb9b055aad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:16.763012 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e5d9e1cc-f841-4914-9a77-cbeb9b055aad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:16.772175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e5d9e1cc-f841-4914-9a77-cbeb9b055aad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1261 microversion: 2.1 time: 0.091679 May 10 16:51:16.772800 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 216/426] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:16 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:17.574834 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4b90f1b8-7080-4307-9faf-872b199946f1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:17.575487 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4b90f1b8-7080-4307-9faf-872b199946f1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:17.584629 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4b90f1b8-7080-4307-9faf-872b199946f1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:17.585156 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4b90f1b8-7080-4307-9faf-872b199946f1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:17.586024 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4b90f1b8-7080-4307-9faf-872b199946f1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:17.586530 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4b90f1b8-7080-4307-9faf-872b199946f1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:17.744621 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4b90f1b8-7080-4307-9faf-872b199946f1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:17.754342 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4b90f1b8-7080-4307-9faf-872b199946f1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:17.756253 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4b90f1b8-7080-4307-9faf-872b199946f1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:17.757539 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4b90f1b8-7080-4307-9faf-872b199946f1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.191262 May 10 16:51:17.758393 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 211/427] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:17 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:17.790181 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8d6fd174-94d8-4199-90f3-4d73c681cb6e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:17.790808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8d6fd174-94d8-4199-90f3-4d73c681cb6e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:17.797232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8d6fd174-94d8-4199-90f3-4d73c681cb6e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:17.797690 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8d6fd174-94d8-4199-90f3-4d73c681cb6e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:17.798563 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8d6fd174-94d8-4199-90f3-4d73c681cb6e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:17.799001 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8d6fd174-94d8-4199-90f3-4d73c681cb6e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:17.878858 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8d6fd174-94d8-4199-90f3-4d73c681cb6e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:17.886542 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8d6fd174-94d8-4199-90f3-4d73c681cb6e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1261 microversion: 2.1 time: 0.100165 May 10 16:51:17.887120 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 217/428] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:17 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:18.777405 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-20381854-57f5-4169-9782-f3fdbd9ae293 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:18.778023 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-20381854-57f5-4169-9782-f3fdbd9ae293 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:18.785807 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-20381854-57f5-4169-9782-f3fdbd9ae293 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:18.786275 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-20381854-57f5-4169-9782-f3fdbd9ae293 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:18.787092 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-20381854-57f5-4169-9782-f3fdbd9ae293 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:18.787533 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-20381854-57f5-4169-9782-f3fdbd9ae293 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:18.904541 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a31b9dec-1c73-4e95-9d64-ac9bf2fda40a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:18.905149 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a31b9dec-1c73-4e95-9d64-ac9bf2fda40a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:18.912756 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a31b9dec-1c73-4e95-9d64-ac9bf2fda40a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:18.913383 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a31b9dec-1c73-4e95-9d64-ac9bf2fda40a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:18.914181 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a31b9dec-1c73-4e95-9d64-ac9bf2fda40a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:18.914613 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a31b9dec-1c73-4e95-9d64-ac9bf2fda40a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:18.938392 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-20381854-57f5-4169-9782-f3fdbd9ae293 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:18.958576 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-20381854-57f5-4169-9782-f3fdbd9ae293 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:18.961058 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-20381854-57f5-4169-9782-f3fdbd9ae293 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:18.964686 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-20381854-57f5-4169-9782-f3fdbd9ae293 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.191181 May 10 16:51:18.978238 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 212/429] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:18 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:18.983520 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a31b9dec-1c73-4e95-9d64-ac9bf2fda40a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:18.992163 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a31b9dec-1c73-4e95-9d64-ac9bf2fda40a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1253 microversion: 2.1 time: 0.091532 May 10 16:51:18.992787 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 218/430] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:18 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1253 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:19.990528 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e8f836e3-3ac5-40fb-ba64-d86901658e2e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:19.991642 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e8f836e3-3ac5-40fb-ba64-d86901658e2e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:20.005308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e8f836e3-3ac5-40fb-ba64-d86901658e2e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:20.006241 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e8f836e3-3ac5-40fb-ba64-d86901658e2e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:20.007560 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e8f836e3-3ac5-40fb-ba64-d86901658e2e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:20.008766 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e8f836e3-3ac5-40fb-ba64-d86901658e2e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:20.009932 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ae4959c1-1323-4fb0-a2a8-2fff9317fe5d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:20.010556 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ae4959c1-1323-4fb0-a2a8-2fff9317fe5d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:20.020703 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ae4959c1-1323-4fb0-a2a8-2fff9317fe5d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:20.024538 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ae4959c1-1323-4fb0-a2a8-2fff9317fe5d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:20.025372 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ae4959c1-1323-4fb0-a2a8-2fff9317fe5d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:20.025821 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ae4959c1-1323-4fb0-a2a8-2fff9317fe5d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:20.150739 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ae4959c1-1323-4fb0-a2a8-2fff9317fe5d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:20.159258 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ae4959c1-1323-4fb0-a2a8-2fff9317fe5d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1327 microversion: 2.1 time: 0.152969 May 10 16:51:20.160156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 219/431] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:20 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1327 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:20.186488 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e8f836e3-3ac5-40fb-ba64-d86901658e2e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:20.195358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e8f836e3-3ac5-40fb-ba64-d86901658e2e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:20.196898 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e8f836e3-3ac5-40fb-ba64-d86901658e2e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:20.198367 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e8f836e3-3ac5-40fb-ba64-d86901658e2e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.215633 May 10 16:51:20.198935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 213/432] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:19 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:20.431162 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3dc9cf5c-8ac9-4622-b55f-96f5df2a8174 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:20.432000 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3dc9cf5c-8ac9-4622-b55f-96f5df2a8174 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:20.444829 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf5c-8ac9-4622-b55f-96f5df2a8174 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:20.446805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf5c-8ac9-4622-b55f-96f5df2a8174 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:20.447844 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf5c-8ac9-4622-b55f-96f5df2a8174 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:20.448531 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3dc9cf5c-8ac9-4622-b55f-96f5df2a8174 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:20.511353 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-911cb460-be95-4024-ba72-97b18d19ae55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60874812-f493-423c-ada6-80a0f62d4e94", "device": "/dev/sdb"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:20.514380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-911cb460-be95-4024-ba72-97b18d19ae55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:20.542991 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-911cb460-be95-4024-ba72-97b18d19ae55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:20.544334 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-911cb460-be95-4024-ba72-97b18d19ae55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:20.545602 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-911cb460-be95-4024-ba72-97b18d19ae55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:20.546079 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-911cb460-be95-4024-ba72-97b18d19ae55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:20.651162 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-3dc9cf5c-8ac9-4622-b55f-96f5df2a8174 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lazy-loading 'services' on Instance uuid a2b9076f-b216-4383-b9fd-80b05ada72a8 {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:51:20.897131 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3dc9cf5c-8ac9-4622-b55f-96f5df2a8174 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/os-volume_attachments/80661985-c4ff-412d-a2af-b34bba019b0e" status: 202 len: 0 microversion: 2.1 time: 0.471088 May 10 16:51:20.898560 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 220/433] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:51:20 2022] DELETE /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/os-volume_attachments/80661985-c4ff-412d-a2af-b34bba019b0e => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:51:21.180123 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-eb22d1bb-f1f0-4764-9430-fc904e029dbd tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:21.182433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-eb22d1bb-f1f0-4764-9430-fc904e029dbd tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:21.190014 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb22d1bb-f1f0-4764-9430-fc904e029dbd tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:21.190840 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb22d1bb-f1f0-4764-9430-fc904e029dbd tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:21.191894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb22d1bb-f1f0-4764-9430-fc904e029dbd tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:21.192360 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb22d1bb-f1f0-4764-9430-fc904e029dbd tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:21.372697 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-eb22d1bb-f1f0-4764-9430-fc904e029dbd tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:21.384950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-eb22d1bb-f1f0-4764-9430-fc904e029dbd tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.209945 May 10 16:51:21.389666 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 221/434] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:21 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:21.396228 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b5d01388-f608-4064-8c72-7f0595a35cfa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:21.397694 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b5d01388-f608-4064-8c72-7f0595a35cfa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:21.406848 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5d01388-f608-4064-8c72-7f0595a35cfa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:21.407997 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5d01388-f608-4064-8c72-7f0595a35cfa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:21.409251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5d01388-f608-4064-8c72-7f0595a35cfa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:21.410254 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5d01388-f608-4064-8c72-7f0595a35cfa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:21.565895 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b5d01388-f608-4064-8c72-7f0595a35cfa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:21.574536 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b5d01388-f608-4064-8c72-7f0595a35cfa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:21.576051 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b5d01388-f608-4064-8c72-7f0595a35cfa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:21.577335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b5d01388-f608-4064-8c72-7f0595a35cfa tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.186281 May 10 16:51:21.577902 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 222/435] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:21 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:22.407313 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e6d3bb13-839e-44a6-bae3-54a972223bb5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:22.408622 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e6d3bb13-839e-44a6-bae3-54a972223bb5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:22.415968 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e6d3bb13-839e-44a6-bae3-54a972223bb5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:22.416544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e6d3bb13-839e-44a6-bae3-54a972223bb5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:22.419427 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e6d3bb13-839e-44a6-bae3-54a972223bb5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:22.420156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e6d3bb13-839e-44a6-bae3-54a972223bb5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:22.576904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e6d3bb13-839e-44a6-bae3-54a972223bb5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:22.584569 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e6d3bb13-839e-44a6-bae3-54a972223bb5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.181060 May 10 16:51:22.585148 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 223/436] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:22 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:22.596191 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e8598eff-d0ed-49ad-a929-2efc32064d84 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:22.596832 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e8598eff-d0ed-49ad-a929-2efc32064d84 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:22.603030 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8598eff-d0ed-49ad-a929-2efc32064d84 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:22.603482 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8598eff-d0ed-49ad-a929-2efc32064d84 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:22.604260 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8598eff-d0ed-49ad-a929-2efc32064d84 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:22.604716 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8598eff-d0ed-49ad-a929-2efc32064d84 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:22.740499 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e8598eff-d0ed-49ad-a929-2efc32064d84 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:22.749160 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e8598eff-d0ed-49ad-a929-2efc32064d84 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:22.750683 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e8598eff-d0ed-49ad-a929-2efc32064d84 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:22.752307 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e8598eff-d0ed-49ad-a929-2efc32064d84 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.160102 May 10 16:51:22.752915 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 224/437] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:22 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:23.601642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e070f8fc-d75a-4fa3-92a6-7f0156a747af tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:23.602365 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e070f8fc-d75a-4fa3-92a6-7f0156a747af tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:23.608908 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e070f8fc-d75a-4fa3-92a6-7f0156a747af tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:23.609358 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e070f8fc-d75a-4fa3-92a6-7f0156a747af tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:23.610134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e070f8fc-d75a-4fa3-92a6-7f0156a747af tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:23.611145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e070f8fc-d75a-4fa3-92a6-7f0156a747af tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:23.741404 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e070f8fc-d75a-4fa3-92a6-7f0156a747af tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:23.748748 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e070f8fc-d75a-4fa3-92a6-7f0156a747af tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.150944 May 10 16:51:23.749325 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 225/438] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:23 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:23.770605 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-721b1bd5-28a3-4ce0-a79b-80dc6cb36ce5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:23.771217 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-721b1bd5-28a3-4ce0-a79b-80dc6cb36ce5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:23.777740 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-721b1bd5-28a3-4ce0-a79b-80dc6cb36ce5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:23.778198 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-721b1bd5-28a3-4ce0-a79b-80dc6cb36ce5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:23.778996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-721b1bd5-28a3-4ce0-a79b-80dc6cb36ce5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:23.779442 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-721b1bd5-28a3-4ce0-a79b-80dc6cb36ce5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:23.938666 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-721b1bd5-28a3-4ce0-a79b-80dc6cb36ce5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:23.947341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-721b1bd5-28a3-4ce0-a79b-80dc6cb36ce5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:23.949852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-721b1bd5-28a3-4ce0-a79b-80dc6cb36ce5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:23.951068 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-721b1bd5-28a3-4ce0-a79b-80dc6cb36ce5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.184958 May 10 16:51:23.951879 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 226/439] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:23 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:24.767315 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7114d734-a5e1-4efb-a54c-872ba9e292c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:24.768028 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7114d734-a5e1-4efb-a54c-872ba9e292c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:24.775408 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7114d734-a5e1-4efb-a54c-872ba9e292c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:24.775783 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7114d734-a5e1-4efb-a54c-872ba9e292c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:24.776618 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7114d734-a5e1-4efb-a54c-872ba9e292c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:24.777229 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7114d734-a5e1-4efb-a54c-872ba9e292c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:24.924203 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7114d734-a5e1-4efb-a54c-872ba9e292c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:24.932353 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7114d734-a5e1-4efb-a54c-872ba9e292c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.169617 May 10 16:51:24.942694 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 227/440] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:24 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:24.972721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ee1aeaf2-52e6-4357-ac5e-2f19c4412314 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:24.972721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ee1aeaf2-52e6-4357-ac5e-2f19c4412314 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:24.977891 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ee1aeaf2-52e6-4357-ac5e-2f19c4412314 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:24.978343 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ee1aeaf2-52e6-4357-ac5e-2f19c4412314 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:24.979135 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ee1aeaf2-52e6-4357-ac5e-2f19c4412314 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:24.979553 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ee1aeaf2-52e6-4357-ac5e-2f19c4412314 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:25.123051 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ee1aeaf2-52e6-4357-ac5e-2f19c4412314 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:25.133219 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ee1aeaf2-52e6-4357-ac5e-2f19c4412314 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:25.134747 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ee1aeaf2-52e6-4357-ac5e-2f19c4412314 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:25.135925 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ee1aeaf2-52e6-4357-ac5e-2f19c4412314 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.169736 May 10 16:51:25.136532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 228/441] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:24 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:25.950599 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1ccd9d53-736b-458c-95a3-16f2f568eed0 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:25.951323 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1ccd9d53-736b-458c-95a3-16f2f568eed0 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:25.958751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1ccd9d53-736b-458c-95a3-16f2f568eed0 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:25.959207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1ccd9d53-736b-458c-95a3-16f2f568eed0 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:25.959995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1ccd9d53-736b-458c-95a3-16f2f568eed0 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:25.960463 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1ccd9d53-736b-458c-95a3-16f2f568eed0 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:26.108769 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1ccd9d53-736b-458c-95a3-16f2f568eed0 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:26.117076 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1ccd9d53-736b-458c-95a3-16f2f568eed0 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.170291 May 10 16:51:26.117886 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 229/442] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:25 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:26.156397 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8a713050-e8ca-4be9-9c4a-ca03f0bff35f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:26.156999 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8a713050-e8ca-4be9-9c4a-ca03f0bff35f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:26.164009 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8a713050-e8ca-4be9-9c4a-ca03f0bff35f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:26.164509 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8a713050-e8ca-4be9-9c4a-ca03f0bff35f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:26.165276 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8a713050-e8ca-4be9-9c4a-ca03f0bff35f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:26.165708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8a713050-e8ca-4be9-9c4a-ca03f0bff35f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:26.302587 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8a713050-e8ca-4be9-9c4a-ca03f0bff35f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:26.321266 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8a713050-e8ca-4be9-9c4a-ca03f0bff35f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:26.323300 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8a713050-e8ca-4be9-9c4a-ca03f0bff35f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:26.324828 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8a713050-e8ca-4be9-9c4a-ca03f0bff35f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.172548 May 10 16:51:26.336265 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 230/443] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:26 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:27.134177 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-df3ec1ac-919a-4155-ba6f-aac64e921a2c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:27.134904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-df3ec1ac-919a-4155-ba6f-aac64e921a2c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:27.141138 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-df3ec1ac-919a-4155-ba6f-aac64e921a2c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:27.141625 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-df3ec1ac-919a-4155-ba6f-aac64e921a2c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:27.142401 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-df3ec1ac-919a-4155-ba6f-aac64e921a2c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:27.142841 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-df3ec1ac-919a-4155-ba6f-aac64e921a2c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:27.286225 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-df3ec1ac-919a-4155-ba6f-aac64e921a2c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:27.293444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-df3ec1ac-919a-4155-ba6f-aac64e921a2c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.163160 May 10 16:51:27.294017 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 231/444] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:27 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:27.353156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8e344907-1cdb-4513-8a56-eb9274c5dd87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:27.356658 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8e344907-1cdb-4513-8a56-eb9274c5dd87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:27.363092 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8e344907-1cdb-4513-8a56-eb9274c5dd87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:27.363578 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8e344907-1cdb-4513-8a56-eb9274c5dd87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:27.364394 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8e344907-1cdb-4513-8a56-eb9274c5dd87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:27.364839 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8e344907-1cdb-4513-8a56-eb9274c5dd87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:27.542086 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8e344907-1cdb-4513-8a56-eb9274c5dd87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:27.553478 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8e344907-1cdb-4513-8a56-eb9274c5dd87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:27.555105 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8e344907-1cdb-4513-8a56-eb9274c5dd87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:27.556334 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8e344907-1cdb-4513-8a56-eb9274c5dd87 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.212244 May 10 16:51:27.557574 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 232/445] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:27 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:28.314691 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6956a8ce-be1d-47ea-9ec8-a4306eb3f5a9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:28.316512 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6956a8ce-be1d-47ea-9ec8-a4306eb3f5a9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:28.326275 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6956a8ce-be1d-47ea-9ec8-a4306eb3f5a9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:28.327115 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6956a8ce-be1d-47ea-9ec8-a4306eb3f5a9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:28.328425 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6956a8ce-be1d-47ea-9ec8-a4306eb3f5a9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:28.329126 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6956a8ce-be1d-47ea-9ec8-a4306eb3f5a9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:28.478666 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6956a8ce-be1d-47ea-9ec8-a4306eb3f5a9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:28.486653 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6956a8ce-be1d-47ea-9ec8-a4306eb3f5a9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.177842 May 10 16:51:28.487225 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 233/446] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:28 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:28.589825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-68953ad5-f514-40ed-8c56-ff47175c70ee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:28.590999 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-68953ad5-f514-40ed-8c56-ff47175c70ee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:28.598144 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-68953ad5-f514-40ed-8c56-ff47175c70ee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:28.598598 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-68953ad5-f514-40ed-8c56-ff47175c70ee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:28.599356 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-68953ad5-f514-40ed-8c56-ff47175c70ee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:28.599795 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-68953ad5-f514-40ed-8c56-ff47175c70ee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:28.748039 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-68953ad5-f514-40ed-8c56-ff47175c70ee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:28.756636 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-68953ad5-f514-40ed-8c56-ff47175c70ee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:28.758135 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-68953ad5-f514-40ed-8c56-ff47175c70ee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:28.759284 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-68953ad5-f514-40ed-8c56-ff47175c70ee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.173445 May 10 16:51:28.759847 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 234/447] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:28 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:29.503901 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4ff59991-c17f-4478-b051-470caafad9ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:29.504643 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4ff59991-c17f-4478-b051-470caafad9ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:29.511028 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4ff59991-c17f-4478-b051-470caafad9ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:29.511478 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4ff59991-c17f-4478-b051-470caafad9ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:29.512257 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4ff59991-c17f-4478-b051-470caafad9ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:29.512713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4ff59991-c17f-4478-b051-470caafad9ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:29.650145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4ff59991-c17f-4478-b051-470caafad9ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:29.659111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4ff59991-c17f-4478-b051-470caafad9ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.159608 May 10 16:51:29.659835 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 235/448] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:29 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:29.778631 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b8a36c3c-8d45-4de5-a9f9-95d29e31430d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:29.779279 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b8a36c3c-8d45-4de5-a9f9-95d29e31430d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:29.785886 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b8a36c3c-8d45-4de5-a9f9-95d29e31430d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:29.786349 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b8a36c3c-8d45-4de5-a9f9-95d29e31430d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:29.787159 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b8a36c3c-8d45-4de5-a9f9-95d29e31430d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:29.787641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b8a36c3c-8d45-4de5-a9f9-95d29e31430d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:29.931816 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b8a36c3c-8d45-4de5-a9f9-95d29e31430d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:29.940260 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b8a36c3c-8d45-4de5-a9f9-95d29e31430d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:29.941789 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b8a36c3c-8d45-4de5-a9f9-95d29e31430d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:29.942939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b8a36c3c-8d45-4de5-a9f9-95d29e31430d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.168509 May 10 16:51:29.943506 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 236/449] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:29 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:30.675908 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ad4d9f8e-410d-4a8a-a14b-f0aa39856857 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:30.676604 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ad4d9f8e-410d-4a8a-a14b-f0aa39856857 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:30.682873 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ad4d9f8e-410d-4a8a-a14b-f0aa39856857 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:30.683373 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ad4d9f8e-410d-4a8a-a14b-f0aa39856857 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:30.684088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ad4d9f8e-410d-4a8a-a14b-f0aa39856857 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:30.684550 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ad4d9f8e-410d-4a8a-a14b-f0aa39856857 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:30.920929 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ad4d9f8e-410d-4a8a-a14b-f0aa39856857 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:30.929106 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ad4d9f8e-410d-4a8a-a14b-f0aa39856857 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.257483 May 10 16:51:30.929691 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 237/450] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:30 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:30.961313 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-39b3ee25-f013-4cc8-995a-c1e2c201606d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:30.961830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-39b3ee25-f013-4cc8-995a-c1e2c201606d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:30.967641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39b3ee25-f013-4cc8-995a-c1e2c201606d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:30.968079 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39b3ee25-f013-4cc8-995a-c1e2c201606d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:30.968871 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39b3ee25-f013-4cc8-995a-c1e2c201606d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:30.969303 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39b3ee25-f013-4cc8-995a-c1e2c201606d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:31.171250 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-39b3ee25-f013-4cc8-995a-c1e2c201606d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:31.182858 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-39b3ee25-f013-4cc8-995a-c1e2c201606d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:31.184499 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-39b3ee25-f013-4cc8-995a-c1e2c201606d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:31.185646 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-39b3ee25-f013-4cc8-995a-c1e2c201606d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.228431 May 10 16:51:31.186403 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 238/451] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:30 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:31.442458 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-d0365ebb-6a47-4e3a-abe8-d2c9d44112d6 req-c1fc7e4c-b1bd-495e-9888-0fd3e2fe9a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f5143e-66c5-4637-b754-ae72952cc5ae", "tag": "b30dc8d6-b194-432b-996f-a760a67504fc"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:31.467893 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-d0365ebb-6a47-4e3a-abe8-d2c9d44112d6 req-c1fc7e4c-b1bd-495e-9888-0fd3e2fe9a1c service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:31.468304 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-d0365ebb-6a47-4e3a-abe8-d2c9d44112d6 req-c1fc7e4c-b1bd-495e-9888-0fd3e2fe9a1c service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:31.483768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-d0365ebb-6a47-4e3a-abe8-d2c9d44112d6 req-c1fc7e4c-b1bd-495e-9888-0fd3e2fe9a1c service nova] Creating event network-changed:b30dc8d6-b194-432b-996f-a760a67504fc for instance 25f5143e-66c5-4637-b754-ae72952cc5ae on hv-cinder-83588 May 10 16:51:31.490912 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-d0365ebb-6a47-4e3a-abe8-d2c9d44112d6 req-c1fc7e4c-b1bd-495e-9888-0fd3e2fe9a1c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058008 May 10 16:51:31.492524 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 239/452] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:51:31.642159 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-911cb460-be95-4024-ba72-97b18d19ae55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "POST /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.134538 May 10 16:51:31.643155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 214/453] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:51:20 2022] POST /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a/os-volume_attachments => generated 194 bytes in 11137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:51:31.946807 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c62fa195-7d14-4e29-b7da-d9d04185786f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:31.949490 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c62fa195-7d14-4e29-b7da-d9d04185786f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:31.959213 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c62fa195-7d14-4e29-b7da-d9d04185786f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:31.959901 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c62fa195-7d14-4e29-b7da-d9d04185786f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:31.961295 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c62fa195-7d14-4e29-b7da-d9d04185786f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:31.961982 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c62fa195-7d14-4e29-b7da-d9d04185786f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:32.140054 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c62fa195-7d14-4e29-b7da-d9d04185786f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:32.148489 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c62fa195-7d14-4e29-b7da-d9d04185786f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.205962 May 10 16:51:32.149085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 240/454] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:31 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:32.206038 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-12db3851-9932-4e4f-ac6f-7b8727033f51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:32.206782 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-12db3851-9932-4e4f-ac6f-7b8727033f51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:32.214013 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-12db3851-9932-4e4f-ac6f-7b8727033f51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:32.214750 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-12db3851-9932-4e4f-ac6f-7b8727033f51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:32.215543 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-12db3851-9932-4e4f-ac6f-7b8727033f51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:32.215976 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-12db3851-9932-4e4f-ac6f-7b8727033f51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:32.371144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-12db3851-9932-4e4f-ac6f-7b8727033f51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:32.380159 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-12db3851-9932-4e4f-ac6f-7b8727033f51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:32.381765 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-12db3851-9932-4e4f-ac6f-7b8727033f51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:32.382942 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-12db3851-9932-4e4f-ac6f-7b8727033f51 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.182168 May 10 16:51:32.383700 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 215/455] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:32 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:32.691598 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-080494d2-e8bd-48ef-9205-9bef5da166d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:32.697904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-080494d2-e8bd-48ef-9205-9bef5da166d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:32.698565 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-080494d2-e8bd-48ef-9205-9bef5da166d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:32.762604 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-080494d2-e8bd-48ef-9205-9bef5da166d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Going to try to stop instance {{(pid=134195) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 16:51:32.809639 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-080494d2-e8bd-48ef-9205-9bef5da166d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/action" status: 202 len: 0 microversion: 2.1 time: 0.122247 May 10 16:51:32.810164 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 241/456] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:51:32 2022] POST /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:51:32.818383 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ff0f88e4-0bd6-418d-a197-9493f0559a0c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:32.819025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ff0f88e4-0bd6-418d-a197-9493f0559a0c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:32.826662 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff0f88e4-0bd6-418d-a197-9493f0559a0c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:32.827115 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff0f88e4-0bd6-418d-a197-9493f0559a0c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:32.827928 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff0f88e4-0bd6-418d-a197-9493f0559a0c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:32.828411 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff0f88e4-0bd6-418d-a197-9493f0559a0c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:32.966681 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ff0f88e4-0bd6-418d-a197-9493f0559a0c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:32.974949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ff0f88e4-0bd6-418d-a197-9493f0559a0c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.160397 May 10 16:51:32.975538 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 216/457] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:32 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:33.168960 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d2ddfc43-d7ad-4572-8f78-e0424f34915f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:33.169684 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d2ddfc43-d7ad-4572-8f78-e0424f34915f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:33.176701 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d2ddfc43-d7ad-4572-8f78-e0424f34915f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:33.177156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d2ddfc43-d7ad-4572-8f78-e0424f34915f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:33.177938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d2ddfc43-d7ad-4572-8f78-e0424f34915f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:33.178378 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d2ddfc43-d7ad-4572-8f78-e0424f34915f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:33.327195 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d2ddfc43-d7ad-4572-8f78-e0424f34915f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:33.337464 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d2ddfc43-d7ad-4572-8f78-e0424f34915f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.173029 May 10 16:51:33.340072 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 242/458] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:33 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:33.401021 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7b6fdcd1-fb47-4df9-8996-6e024d262fe4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:33.401622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7b6fdcd1-fb47-4df9-8996-6e024d262fe4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:33.408332 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7b6fdcd1-fb47-4df9-8996-6e024d262fe4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:33.408787 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7b6fdcd1-fb47-4df9-8996-6e024d262fe4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:33.409560 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7b6fdcd1-fb47-4df9-8996-6e024d262fe4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:33.409990 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7b6fdcd1-fb47-4df9-8996-6e024d262fe4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:33.550497 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7b6fdcd1-fb47-4df9-8996-6e024d262fe4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:33.561299 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7b6fdcd1-fb47-4df9-8996-6e024d262fe4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:33.562805 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7b6fdcd1-fb47-4df9-8996-6e024d262fe4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:33.564827 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7b6fdcd1-fb47-4df9-8996-6e024d262fe4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.167407 May 10 16:51:33.565442 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 217/459] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:33 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:33.992533 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-698b7967-10c2-457e-b3a1-cb501a40ff6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:33.993148 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-698b7967-10c2-457e-b3a1-cb501a40ff6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:33.999399 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-698b7967-10c2-457e-b3a1-cb501a40ff6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:33.999880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-698b7967-10c2-457e-b3a1-cb501a40ff6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:34.000698 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-698b7967-10c2-457e-b3a1-cb501a40ff6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:34.001335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-698b7967-10c2-457e-b3a1-cb501a40ff6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:34.139677 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-698b7967-10c2-457e-b3a1-cb501a40ff6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:34.148335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-698b7967-10c2-457e-b3a1-cb501a40ff6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.159611 May 10 16:51:34.148921 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 243/460] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:33 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:34.354684 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-1918cbd5-3886-42ff-b3d3-42788a4bded3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:34.355302 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-1918cbd5-3886-42ff-b3d3-42788a4bded3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:34.361896 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1918cbd5-3886-42ff-b3d3-42788a4bded3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:34.362344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1918cbd5-3886-42ff-b3d3-42788a4bded3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:34.363150 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1918cbd5-3886-42ff-b3d3-42788a4bded3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:34.363594 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1918cbd5-3886-42ff-b3d3-42788a4bded3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:34.518246 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-1918cbd5-3886-42ff-b3d3-42788a4bded3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:34.525793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-1918cbd5-3886-42ff-b3d3-42788a4bded3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.174903 May 10 16:51:34.526379 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 218/461] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:34 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:34.584373 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a848ad05-3813-41dc-bd8a-e311dc77128f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:34.587642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a848ad05-3813-41dc-bd8a-e311dc77128f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:34.591635 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a848ad05-3813-41dc-bd8a-e311dc77128f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:34.592122 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a848ad05-3813-41dc-bd8a-e311dc77128f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:34.592953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a848ad05-3813-41dc-bd8a-e311dc77128f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:34.593423 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a848ad05-3813-41dc-bd8a-e311dc77128f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:34.748525 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a848ad05-3813-41dc-bd8a-e311dc77128f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:34.753990 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-29c018f8-d3ab-4711-af0d-7f31587bd756 req-d661eea0-15a0-4ab7-9f27-9de1ec270fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6739110-4e68-4993-83ec-7c1503f7b87b", "name": "network-vif-plugged", "status": "completed", "tag": "494f67f0-21ef-40e7-8bd0-9ab88f71dbef"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:34.758623 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a848ad05-3813-41dc-bd8a-e311dc77128f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:34.760342 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a848ad05-3813-41dc-bd8a-e311dc77128f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:34.761663 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a848ad05-3813-41dc-bd8a-e311dc77128f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.182328 May 10 16:51:34.762690 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 244/462] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:34 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:34.773254 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-29c018f8-d3ab-4711-af0d-7f31587bd756 req-d661eea0-15a0-4ab7-9f27-9de1ec270fdb service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:34.773717 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-29c018f8-d3ab-4711-af0d-7f31587bd756 req-d661eea0-15a0-4ab7-9f27-9de1ec270fdb service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:34.788511 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-29c018f8-d3ab-4711-af0d-7f31587bd756 req-d661eea0-15a0-4ab7-9f27-9de1ec270fdb service nova] Creating event network-vif-plugged:494f67f0-21ef-40e7-8bd0-9ab88f71dbef for instance c6739110-4e68-4993-83ec-7c1503f7b87b on hv-cinder-83588 May 10 16:51:34.793540 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-29c018f8-d3ab-4711-af0d-7f31587bd756 req-d661eea0-15a0-4ab7-9f27-9de1ec270fdb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045103 May 10 16:51:34.794147 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 219/463] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:51:35.167806 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-932f4397-2cc7-4be7-8b21-502457ab2e4d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:35.168909 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-932f4397-2cc7-4be7-8b21-502457ab2e4d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:35.178487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-932f4397-2cc7-4be7-8b21-502457ab2e4d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:35.179041 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-932f4397-2cc7-4be7-8b21-502457ab2e4d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:35.179917 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-932f4397-2cc7-4be7-8b21-502457ab2e4d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:35.180556 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-932f4397-2cc7-4be7-8b21-502457ab2e4d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:35.338092 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-932f4397-2cc7-4be7-8b21-502457ab2e4d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:35.346988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-932f4397-2cc7-4be7-8b21-502457ab2e4d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.184255 May 10 16:51:35.347622 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 245/464] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:35 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:35.544696 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-91e8111a-6dba-4b8a-8bbc-954bc38960d5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:35.545460 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-91e8111a-6dba-4b8a-8bbc-954bc38960d5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:35.553063 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-91e8111a-6dba-4b8a-8bbc-954bc38960d5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:35.553604 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-91e8111a-6dba-4b8a-8bbc-954bc38960d5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:35.554473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-91e8111a-6dba-4b8a-8bbc-954bc38960d5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:35.554971 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-91e8111a-6dba-4b8a-8bbc-954bc38960d5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:35.694445 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-91e8111a-6dba-4b8a-8bbc-954bc38960d5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:35.703196 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-91e8111a-6dba-4b8a-8bbc-954bc38960d5 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.163670 May 10 16:51:35.704563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 220/465] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:35 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:35.785052 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-959b6578-5bdc-4dd8-8035-60c984e89297 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:35.787266 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-959b6578-5bdc-4dd8-8035-60c984e89297 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:35.794708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-959b6578-5bdc-4dd8-8035-60c984e89297 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:35.795160 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-959b6578-5bdc-4dd8-8035-60c984e89297 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:35.795936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-959b6578-5bdc-4dd8-8035-60c984e89297 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:35.796399 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-959b6578-5bdc-4dd8-8035-60c984e89297 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:35.953505 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-959b6578-5bdc-4dd8-8035-60c984e89297 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:35.963737 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-959b6578-5bdc-4dd8-8035-60c984e89297 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:35.965564 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-959b6578-5bdc-4dd8-8035-60c984e89297 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:35.966740 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-959b6578-5bdc-4dd8-8035-60c984e89297 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.185708 May 10 16:51:35.967341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 246/466] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:35 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:36.366130 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-59a40d24-d695-46c7-afc1-79c6e97c7f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:36.366735 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-59a40d24-d695-46c7-afc1-79c6e97c7f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:36.372749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-59a40d24-d695-46c7-afc1-79c6e97c7f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:36.373227 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-59a40d24-d695-46c7-afc1-79c6e97c7f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:36.373993 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-59a40d24-d695-46c7-afc1-79c6e97c7f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:36.374422 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-59a40d24-d695-46c7-afc1-79c6e97c7f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:36.523112 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-59a40d24-d695-46c7-afc1-79c6e97c7f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:36.531146 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-59a40d24-d695-46c7-afc1-79c6e97c7f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.168733 May 10 16:51:36.540948 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 221/467] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:36 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:36.721836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-515f52d9-313b-402a-8511-9361c488bd66 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:36.722394 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-515f52d9-313b-402a-8511-9361c488bd66 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:36.728619 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-515f52d9-313b-402a-8511-9361c488bd66 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:36.729075 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-515f52d9-313b-402a-8511-9361c488bd66 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:36.729849 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-515f52d9-313b-402a-8511-9361c488bd66 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:36.730287 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-515f52d9-313b-402a-8511-9361c488bd66 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:36.814672 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-fc49fdc4-fb6f-43b1-849c-f690f36fdd44 req-2bfb7cc3-0179-429a-896d-db4c4e4fbdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f5143e-66c5-4637-b754-ae72952cc5ae", "name": "network-vif-plugged", "status": "completed", "tag": "b30dc8d6-b194-432b-996f-a760a67504fc"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:36.824569 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-fc49fdc4-fb6f-43b1-849c-f690f36fdd44 req-2bfb7cc3-0179-429a-896d-db4c4e4fbdf0 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:36.827497 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-fc49fdc4-fb6f-43b1-849c-f690f36fdd44 req-2bfb7cc3-0179-429a-896d-db4c4e4fbdf0 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:36.839806 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-fc49fdc4-fb6f-43b1-849c-f690f36fdd44 req-2bfb7cc3-0179-429a-896d-db4c4e4fbdf0 service nova] Creating event network-vif-plugged:b30dc8d6-b194-432b-996f-a760a67504fc for instance 25f5143e-66c5-4637-b754-ae72952cc5ae on hv-cinder-83588 May 10 16:51:36.845431 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-fc49fdc4-fb6f-43b1-849c-f690f36fdd44 req-2bfb7cc3-0179-429a-896d-db4c4e4fbdf0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033904 May 10 16:51:36.846037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 222/468] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:51:36.885089 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-515f52d9-313b-402a-8511-9361c488bd66 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:36.893012 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-515f52d9-313b-402a-8511-9361c488bd66 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.175777 May 10 16:51:36.893619 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 247/469] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:36 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:36.986227 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-315bdb33-0bb3-4e7f-91e3-d5183729a03f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:36.987412 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-315bdb33-0bb3-4e7f-91e3-d5183729a03f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:36.993972 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-315bdb33-0bb3-4e7f-91e3-d5183729a03f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:36.994427 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-315bdb33-0bb3-4e7f-91e3-d5183729a03f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:36.995199 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-315bdb33-0bb3-4e7f-91e3-d5183729a03f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:36.995629 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-315bdb33-0bb3-4e7f-91e3-d5183729a03f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:37.150372 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-315bdb33-0bb3-4e7f-91e3-d5183729a03f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:37.160873 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-315bdb33-0bb3-4e7f-91e3-d5183729a03f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:37.162389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-315bdb33-0bb3-4e7f-91e3-d5183729a03f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:37.163655 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-315bdb33-0bb3-4e7f-91e3-d5183729a03f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.181982 May 10 16:51:37.164252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 223/470] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:36 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:37.548852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-aaf4629f-9f2b-41fd-be34-7b56d6609062 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:37.549464 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-aaf4629f-9f2b-41fd-be34-7b56d6609062 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:37.556539 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aaf4629f-9f2b-41fd-be34-7b56d6609062 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:37.556996 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aaf4629f-9f2b-41fd-be34-7b56d6609062 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:37.557924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aaf4629f-9f2b-41fd-be34-7b56d6609062 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:37.558428 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aaf4629f-9f2b-41fd-be34-7b56d6609062 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:37.738933 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-aaf4629f-9f2b-41fd-be34-7b56d6609062 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:37.754043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-aaf4629f-9f2b-41fd-be34-7b56d6609062 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.209227 May 10 16:51:37.754817 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 248/471] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:37 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:37.909768 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-82db8a1c-8029-4db9-ba90-3c9de600ac9d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:37.910306 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-82db8a1c-8029-4db9-ba90-3c9de600ac9d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:37.917134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-82db8a1c-8029-4db9-ba90-3c9de600ac9d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:37.917583 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-82db8a1c-8029-4db9-ba90-3c9de600ac9d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:37.918400 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-82db8a1c-8029-4db9-ba90-3c9de600ac9d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:37.918831 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-82db8a1c-8029-4db9-ba90-3c9de600ac9d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:38.059738 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-82db8a1c-8029-4db9-ba90-3c9de600ac9d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:38.070876 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-82db8a1c-8029-4db9-ba90-3c9de600ac9d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.165083 May 10 16:51:38.071457 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 224/472] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:37 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:38.183614 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a32dcf51-1993-4655-a40d-33954f09f2f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:38.184208 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a32dcf51-1993-4655-a40d-33954f09f2f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:38.190882 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a32dcf51-1993-4655-a40d-33954f09f2f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:38.191427 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a32dcf51-1993-4655-a40d-33954f09f2f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:38.192298 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a32dcf51-1993-4655-a40d-33954f09f2f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:38.192741 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a32dcf51-1993-4655-a40d-33954f09f2f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:38.330887 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a32dcf51-1993-4655-a40d-33954f09f2f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:38.339492 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a32dcf51-1993-4655-a40d-33954f09f2f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:38.341048 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a32dcf51-1993-4655-a40d-33954f09f2f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:38.342221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a32dcf51-1993-4655-a40d-33954f09f2f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1808 microversion: 2.20 time: 0.162627 May 10 16:51:38.342787 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 249/473] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:38 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:38.771812 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-21aea061-02f5-446f-a03b-84feeb86b62b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:38.772387 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-21aea061-02f5-446f-a03b-84feeb86b62b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:38.778927 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21aea061-02f5-446f-a03b-84feeb86b62b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:38.779389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21aea061-02f5-446f-a03b-84feeb86b62b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:38.780200 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21aea061-02f5-446f-a03b-84feeb86b62b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:38.780664 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-21aea061-02f5-446f-a03b-84feeb86b62b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:38.922026 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-21aea061-02f5-446f-a03b-84feeb86b62b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:38.930119 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-21aea061-02f5-446f-a03b-84feeb86b62b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.162212 May 10 16:51:38.930698 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 225/474] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:38 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:39.087060 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7df9ce4b-2bd2-4a6c-89d2-1ca2cfa082c2 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:39.087618 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7df9ce4b-2bd2-4a6c-89d2-1ca2cfa082c2 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:39.095407 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7df9ce4b-2bd2-4a6c-89d2-1ca2cfa082c2 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:39.095945 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7df9ce4b-2bd2-4a6c-89d2-1ca2cfa082c2 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:39.096862 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7df9ce4b-2bd2-4a6c-89d2-1ca2cfa082c2 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:39.097396 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7df9ce4b-2bd2-4a6c-89d2-1ca2cfa082c2 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:39.362233 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d7ad4671-dfe1-49ca-9d1f-db4e48b08156 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:39.362881 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d7ad4671-dfe1-49ca-9d1f-db4e48b08156 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:39.369886 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7ad4671-dfe1-49ca-9d1f-db4e48b08156 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:39.370342 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7ad4671-dfe1-49ca-9d1f-db4e48b08156 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:39.371236 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7ad4671-dfe1-49ca-9d1f-db4e48b08156 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:39.371713 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7ad4671-dfe1-49ca-9d1f-db4e48b08156 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:39.487873 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7df9ce4b-2bd2-4a6c-89d2-1ca2cfa082c2 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:39.496061 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7df9ce4b-2bd2-4a6c-89d2-1ca2cfa082c2 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1357 microversion: 2.1 time: 0.412957 May 10 16:51:39.496687 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 250/475] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:39 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1357 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:39.515174 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d7ad4671-dfe1-49ca-9d1f-db4e48b08156 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:39.524829 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d7ad4671-dfe1-49ca-9d1f-db4e48b08156 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:39.526454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d7ad4671-dfe1-49ca-9d1f-db4e48b08156 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:39.527646 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d7ad4671-dfe1-49ca-9d1f-db4e48b08156 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1795 microversion: 2.20 time: 0.170468 May 10 16:51:39.528240 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 226/476] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:51:39 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1795 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:39.948345 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-fd0d5f61-a0d6-4402-b896-0a4153024c34 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:39.949642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-fd0d5f61-a0d6-4402-b896-0a4153024c34 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:39.956987 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fd0d5f61-a0d6-4402-b896-0a4153024c34 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:39.957461 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fd0d5f61-a0d6-4402-b896-0a4153024c34 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:39.958272 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fd0d5f61-a0d6-4402-b896-0a4153024c34 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:39.958735 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fd0d5f61-a0d6-4402-b896-0a4153024c34 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:40.112850 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-fd0d5f61-a0d6-4402-b896-0a4153024c34 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:40.117220 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-fd0d5f61-a0d6-4402-b896-0a4153024c34 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.174057 May 10 16:51:40.117811 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 251/477] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:39 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:40.515326 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9fa4d47a-d57c-4f1b-8163-278183ddaca3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:40.517071 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9fa4d47a-d57c-4f1b-8163-278183ddaca3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:40.524109 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9fa4d47a-d57c-4f1b-8163-278183ddaca3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:40.524610 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9fa4d47a-d57c-4f1b-8163-278183ddaca3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:40.525431 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9fa4d47a-d57c-4f1b-8163-278183ddaca3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:40.525878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9fa4d47a-d57c-4f1b-8163-278183ddaca3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:40.671588 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9fa4d47a-d57c-4f1b-8163-278183ddaca3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:40.679621 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9fa4d47a-d57c-4f1b-8163-278183ddaca3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1548 microversion: 2.1 time: 0.168576 May 10 16:51:40.680211 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 227/478] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:40 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:40.696762 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8ac4b6f0-5c42-45c4-91bc-e85f2b01b4a3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:40.697380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8ac4b6f0-5c42-45c4-91bc-e85f2b01b4a3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:40.705233 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8ac4b6f0-5c42-45c4-91bc-e85f2b01b4a3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:40.705704 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8ac4b6f0-5c42-45c4-91bc-e85f2b01b4a3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:40.706497 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8ac4b6f0-5c42-45c4-91bc-e85f2b01b4a3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:40.706941 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8ac4b6f0-5c42-45c4-91bc-e85f2b01b4a3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:40.842153 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8ac4b6f0-5c42-45c4-91bc-e85f2b01b4a3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:40.849796 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8ac4b6f0-5c42-45c4-91bc-e85f2b01b4a3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1548 microversion: 2.1 time: 0.156850 May 10 16:51:40.850405 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 252/479] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:40 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:40.868692 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4695d2a6-38d6-499d-91d3-38d1abd7b6d7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:40.872200 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4695d2a6-38d6-499d-91d3-38d1abd7b6d7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:40.873095 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4695d2a6-38d6-499d-91d3-38d1abd7b6d7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Searching by: {'deleted': False, 'project_id': 'ad2249e85fd741258c91142e19edc714'} {{(pid=134194) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 16:51:40.881227 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4695d2a6-38d6-499d-91d3-38d1abd7b6d7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:40.881677 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4695d2a6-38d6-499d-91d3-38d1abd7b6d7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:40.882485 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4695d2a6-38d6-499d-91d3-38d1abd7b6d7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:40.882923 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4695d2a6-38d6-499d-91d3-38d1abd7b6d7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:40.977956 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.multi_cell_list [None req-4695d2a6-38d6-499d-91d3-38d1abd7b6d7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134194) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 16:51:41.076947 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4695d2a6-38d6-499d-91d3-38d1abd7b6d7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211832 May 10 16:51:41.077463 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 228/480] 10.222.0.48 () {58 vars in 1124 bytes} [Tue May 10 16:51:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:51:41.088045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d4a89898-0129-4354-8a5c-c8ca528922c1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:41.088698 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d4a89898-0129-4354-8a5c-c8ca528922c1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:41.094878 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d4a89898-0129-4354-8a5c-c8ca528922c1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:41.095321 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d4a89898-0129-4354-8a5c-c8ca528922c1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:41.096099 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d4a89898-0129-4354-8a5c-c8ca528922c1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:41.096563 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d4a89898-0129-4354-8a5c-c8ca528922c1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:41.134304 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-95c36be7-ad70-4eea-8882-3d9344ea07de tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:41.134955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-95c36be7-ad70-4eea-8882-3d9344ea07de tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:41.141373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-95c36be7-ad70-4eea-8882-3d9344ea07de tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:41.141837 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-95c36be7-ad70-4eea-8882-3d9344ea07de tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:41.142641 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-95c36be7-ad70-4eea-8882-3d9344ea07de tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:41.143156 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-95c36be7-ad70-4eea-8882-3d9344ea07de tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:41.231844 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d4a89898-0129-4354-8a5c-c8ca528922c1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:41.240344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d4a89898-0129-4354-8a5c-c8ca528922c1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1548 microversion: 2.1 time: 0.156090 May 10 16:51:41.240929 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 253/481] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:41 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:41.280079 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-95c36be7-ad70-4eea-8882-3d9344ea07de tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:41.288242 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-95c36be7-ad70-4eea-8882-3d9344ea07de tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.157766 May 10 16:51:41.288862 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 229/482] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:41 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:42.306817 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5f3272a6-e26a-4076-aa4c-8e9091177858 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:42.307644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-5f3272a6-e26a-4076-aa4c-8e9091177858 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:42.314799 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5f3272a6-e26a-4076-aa4c-8e9091177858 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:42.315250 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5f3272a6-e26a-4076-aa4c-8e9091177858 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:42.316040 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5f3272a6-e26a-4076-aa4c-8e9091177858 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:42.316512 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5f3272a6-e26a-4076-aa4c-8e9091177858 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:42.448975 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5f3272a6-e26a-4076-aa4c-8e9091177858 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:42.456995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5f3272a6-e26a-4076-aa4c-8e9091177858 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.154130 May 10 16:51:42.457582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 254/483] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:42 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:43.474202 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2afda1b0-2e1c-4520-8dd7-cb0f19f1432c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:43.474798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2afda1b0-2e1c-4520-8dd7-cb0f19f1432c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:43.481379 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2afda1b0-2e1c-4520-8dd7-cb0f19f1432c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:43.481829 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2afda1b0-2e1c-4520-8dd7-cb0f19f1432c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:43.482608 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2afda1b0-2e1c-4520-8dd7-cb0f19f1432c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:43.483049 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2afda1b0-2e1c-4520-8dd7-cb0f19f1432c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:43.622591 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2afda1b0-2e1c-4520-8dd7-cb0f19f1432c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:43.633325 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2afda1b0-2e1c-4520-8dd7-cb0f19f1432c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.163133 May 10 16:51:43.634292 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 230/484] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:43 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:44.651355 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-da1524cd-7806-40b6-b585-c185952525bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:44.652005 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-da1524cd-7806-40b6-b585-c185952525bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:44.660034 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-da1524cd-7806-40b6-b585-c185952525bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:44.661954 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-da1524cd-7806-40b6-b585-c185952525bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:44.661954 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-da1524cd-7806-40b6-b585-c185952525bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:44.662315 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-da1524cd-7806-40b6-b585-c185952525bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:44.821708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-da1524cd-7806-40b6-b585-c185952525bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:44.830291 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-da1524cd-7806-40b6-b585-c185952525bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.182769 May 10 16:51:44.831148 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 255/485] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:44 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:44.924563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e391d169-9a93-4fc8-ba58-f1bb542ce8ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:44.925991 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e391d169-9a93-4fc8-ba58-f1bb542ce8ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:44.932860 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e391d169-9a93-4fc8-ba58-f1bb542ce8ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:44.933309 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e391d169-9a93-4fc8-ba58-f1bb542ce8ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:44.934092 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e391d169-9a93-4fc8-ba58-f1bb542ce8ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:44.934680 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e391d169-9a93-4fc8-ba58-f1bb542ce8ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:45.194327 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e391d169-9a93-4fc8-ba58-f1bb542ce8ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "POST /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274872 May 10 16:51:45.194942 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 231/486] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:51:44 2022] POST /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:51:45.851784 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c5323628-da0e-43c0-b01a-b93c8c502384 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:45.852405 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c5323628-da0e-43c0-b01a-b93c8c502384 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:45.859397 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5323628-da0e-43c0-b01a-b93c8c502384 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:45.860495 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5323628-da0e-43c0-b01a-b93c8c502384 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:45.861570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5323628-da0e-43c0-b01a-b93c8c502384 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:45.862110 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c5323628-da0e-43c0-b01a-b93c8c502384 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:45.979260 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-686dc48c-2d5e-4b64-920e-50e1a42940fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36421dfd-323a-4180-852b-3fd5f5052a5a"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:45.980445 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-686dc48c-2d5e-4b64-920e-50e1a42940fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:45.988182 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-686dc48c-2d5e-4b64-920e-50e1a42940fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:45.988682 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-686dc48c-2d5e-4b64-920e-50e1a42940fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:45.989491 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-686dc48c-2d5e-4b64-920e-50e1a42940fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:45.989961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-686dc48c-2d5e-4b64-920e-50e1a42940fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:45.996302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c5323628-da0e-43c0-b01a-b93c8c502384 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:46.006373 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c5323628-da0e-43c0-b01a-b93c8c502384 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.158942 May 10 16:51:46.007063 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 256/487] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:45 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:47.023957 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-44246e1e-f631-4261-a58d-c9d450953449 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:47.024620 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-44246e1e-f631-4261-a58d-c9d450953449 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:47.030920 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-44246e1e-f631-4261-a58d-c9d450953449 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:47.031366 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-44246e1e-f631-4261-a58d-c9d450953449 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:47.032787 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-44246e1e-f631-4261-a58d-c9d450953449 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:47.033217 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-44246e1e-f631-4261-a58d-c9d450953449 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:47.166657 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-44246e1e-f631-4261-a58d-c9d450953449 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:47.174798 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-44246e1e-f631-4261-a58d-c9d450953449 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.154413 May 10 16:51:47.175960 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 257/488] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:47 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:47.894612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-686dc48c-2d5e-4b64-920e-50e1a42940fa tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.919755 May 10 16:51:47.895295 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 232/489] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:51:45 2022] POST /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments => generated 194 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:51:48.194067 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ccb01a65-424b-48ea-92aa-7764952a5860 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:48.194712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ccb01a65-424b-48ea-92aa-7764952a5860 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:48.201152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ccb01a65-424b-48ea-92aa-7764952a5860 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:48.201607 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ccb01a65-424b-48ea-92aa-7764952a5860 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:48.202387 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ccb01a65-424b-48ea-92aa-7764952a5860 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:48.202830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ccb01a65-424b-48ea-92aa-7764952a5860 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:48.353453 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ccb01a65-424b-48ea-92aa-7764952a5860 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:48.361272 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ccb01a65-424b-48ea-92aa-7764952a5860 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1677 microversion: 2.1 time: 0.171434 May 10 16:51:48.362365 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 258/490] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:48 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:49.379648 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a3874391-5e39-4b70-b494-04377c0993ee tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:49.380364 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a3874391-5e39-4b70-b494-04377c0993ee tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:49.387114 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a3874391-5e39-4b70-b494-04377c0993ee tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:49.387558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a3874391-5e39-4b70-b494-04377c0993ee tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:49.388350 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a3874391-5e39-4b70-b494-04377c0993ee tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:49.388782 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a3874391-5e39-4b70-b494-04377c0993ee tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:49.781475 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a3874391-5e39-4b70-b494-04377c0993ee tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:49.789483 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a3874391-5e39-4b70-b494-04377c0993ee tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1654 microversion: 2.1 time: 0.414622 May 10 16:51:49.790100 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 233/491] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:49 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1654 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:49.806827 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-74f09f0f-3eef-419e-a0cd-635097e7eb5e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:49.814178 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-74f09f0f-3eef-419e-a0cd-635097e7eb5e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:49.814629 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-74f09f0f-3eef-419e-a0cd-635097e7eb5e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:49.837231 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-74f09f0f-3eef-419e-a0cd-635097e7eb5e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Going to try to start instance {{(pid=134195) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 16:51:49.882148 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-74f09f0f-3eef-419e-a0cd-635097e7eb5e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/action" status: 202 len: 0 microversion: 2.1 time: 0.079034 May 10 16:51:49.882958 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 259/492] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:51:49 2022] POST /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:51:49.892213 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-300ab9df-7467-469b-8de0-fa1bd2a938e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:49.892970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-300ab9df-7467-469b-8de0-fa1bd2a938e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:49.899677 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-300ab9df-7467-469b-8de0-fa1bd2a938e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:49.900137 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-300ab9df-7467-469b-8de0-fa1bd2a938e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:49.901152 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-300ab9df-7467-469b-8de0-fa1bd2a938e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:49.902379 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-300ab9df-7467-469b-8de0-fa1bd2a938e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:50.037046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-300ab9df-7467-469b-8de0-fa1bd2a938e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:50.045126 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-300ab9df-7467-469b-8de0-fa1bd2a938e0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1663 microversion: 2.1 time: 0.157626 May 10 16:51:50.045706 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 234/493] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:49 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:51.065261 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-150f34ef-b64f-4c32-a3f7-3f702ca22564 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:51.065974 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-150f34ef-b64f-4c32-a3f7-3f702ca22564 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:51.072768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-150f34ef-b64f-4c32-a3f7-3f702ca22564 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:51.073216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-150f34ef-b64f-4c32-a3f7-3f702ca22564 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:51.073993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-150f34ef-b64f-4c32-a3f7-3f702ca22564 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:51.074426 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-150f34ef-b64f-4c32-a3f7-3f702ca22564 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:51.094627 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:51:51.094977 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Tue May 10 16:51:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 (ip 10.222.0.48) !!! May 10 16:51:51.214185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-150f34ef-b64f-4c32-a3f7-3f702ca22564 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:51.222381 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-150f34ef-b64f-4c32-a3f7-3f702ca22564 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1663 microversion: 2.1 time: 0.162023 May 10 16:51:51.222957 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 260/494] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:51 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:52.239657 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-50ff5a02-7d1f-4e9c-8f72-8d1dc24263a6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:52.240313 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-50ff5a02-7d1f-4e9c-8f72-8d1dc24263a6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:52.246764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-50ff5a02-7d1f-4e9c-8f72-8d1dc24263a6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:52.247217 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-50ff5a02-7d1f-4e9c-8f72-8d1dc24263a6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:52.247997 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-50ff5a02-7d1f-4e9c-8f72-8d1dc24263a6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:52.248496 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-50ff5a02-7d1f-4e9c-8f72-8d1dc24263a6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:52.393047 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-50ff5a02-7d1f-4e9c-8f72-8d1dc24263a6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:52.401131 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-50ff5a02-7d1f-4e9c-8f72-8d1dc24263a6 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1663 microversion: 2.1 time: 0.165692 May 10 16:51:52.402391 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 235/495] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:52 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:53.423041 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f0ec0b56-d250-4b2e-97db-52f08f5317e9 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:53.424263 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f0ec0b56-d250-4b2e-97db-52f08f5317e9 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:53.432131 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f0ec0b56-d250-4b2e-97db-52f08f5317e9 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:53.432725 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f0ec0b56-d250-4b2e-97db-52f08f5317e9 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:53.433901 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f0ec0b56-d250-4b2e-97db-52f08f5317e9 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:53.434347 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f0ec0b56-d250-4b2e-97db-52f08f5317e9 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:53.581651 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f0ec0b56-d250-4b2e-97db-52f08f5317e9 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:53.598369 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f0ec0b56-d250-4b2e-97db-52f08f5317e9 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1667 microversion: 2.1 time: 0.179895 May 10 16:51:53.599101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 261/496] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:53 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1667 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:55.905373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4d92bf53-0a98-467c-ad4b-df1deb1509d1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:55.905373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4d92bf53-0a98-467c-ad4b-df1deb1509d1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:55.911465 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4d92bf53-0a98-467c-ad4b-df1deb1509d1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:55.911908 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4d92bf53-0a98-467c-ad4b-df1deb1509d1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:55.912703 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4d92bf53-0a98-467c-ad4b-df1deb1509d1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:55.913136 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4d92bf53-0a98-467c-ad4b-df1deb1509d1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:56.042501 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4d92bf53-0a98-467c-ad4b-df1deb1509d1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:56.051259 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4d92bf53-0a98-467c-ad4b-df1deb1509d1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1594 microversion: 2.1 time: 0.150994 May 10 16:51:56.051829 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 236/497] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:55 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1594 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:56.694320 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9ccd20b0-5881-4e12-b349-8d2c7a6af2e6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:56.694869 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9ccd20b0-5881-4e12-b349-8d2c7a6af2e6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:56.701143 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9ccd20b0-5881-4e12-b349-8d2c7a6af2e6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:56.701604 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9ccd20b0-5881-4e12-b349-8d2c7a6af2e6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:56.702386 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9ccd20b0-5881-4e12-b349-8d2c7a6af2e6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:56.702830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9ccd20b0-5881-4e12-b349-8d2c7a6af2e6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:56.787093 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-9ccd20b0-5881-4e12-b349-8d2c7a6af2e6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lazy-loading 'services' on Instance uuid aecdb938-f6bb-4133-bbf8-f4b9645ce76a {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:51:56.866526 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9ccd20b0-5881-4e12-b349-8d2c7a6af2e6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a/os-volume_attachments/60874812-f493-423c-ada6-80a0f62d4e94" status: 202 len: 0 microversion: 2.1 time: 0.171474 May 10 16:51:56.867189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 262/498] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:51:56 2022] DELETE /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a/os-volume_attachments/60874812-f493-423c-ada6-80a0f62d4e94 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:51:57.818853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-d363c0d7-a094-43f9-9fd6-7821e9e326c5 req-e744054e-328a-41fe-9e90-20b612d6e425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f5143e-66c5-4637-b754-ae72952cc5ae", "tag": "b30dc8d6-b194-432b-996f-a760a67504fc"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:57.827246 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-d363c0d7-a094-43f9-9fd6-7821e9e326c5 req-e744054e-328a-41fe-9e90-20b612d6e425 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:57.827696 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-d363c0d7-a094-43f9-9fd6-7821e9e326c5 req-e744054e-328a-41fe-9e90-20b612d6e425 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:57.842771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-d363c0d7-a094-43f9-9fd6-7821e9e326c5 req-e744054e-328a-41fe-9e90-20b612d6e425 service nova] Creating event network-changed:b30dc8d6-b194-432b-996f-a760a67504fc for instance 25f5143e-66c5-4637-b754-ae72952cc5ae on hv-cinder-83588 May 10 16:51:57.848816 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-d363c0d7-a094-43f9-9fd6-7821e9e326c5 req-e744054e-328a-41fe-9e90-20b612d6e425 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033476 May 10 16:51:57.849732 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 237/499] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:51:58.901518 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1cca1c25-2a6b-476b-8956-6910fc95d8fb tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1699835636"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:58.902695 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1cca1c25-2a6b-476b-8956-6910fc95d8fb tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:58.909867 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1cca1c25-2a6b-476b-8956-6910fc95d8fb tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:58.910259 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1cca1c25-2a6b-476b-8956-6910fc95d8fb tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:58.911044 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1cca1c25-2a6b-476b-8956-6910fc95d8fb tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:58.911645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1cca1c25-2a6b-476b-8956-6910fc95d8fb tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:59.053460 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.network.security_group_api [None req-1cca1c25-2a6b-476b-8956-6910fc95d8fb tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Adding security group 7d7dbe47-73cd-401e-ad9c-f0ec589bae2c to port b30dc8d6-b194-432b-996f-a760a67504fc May 10 16:51:59.418862 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1cca1c25-2a6b-476b-8956-6910fc95d8fb tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "POST /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.520800 May 10 16:51:59.420234 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 263/500] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:51:58 2022] POST /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:51:59.425942 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-f128f785-7893-4f62-8e86-400415a35aa7 req-d437249c-f099-401a-8645-d92ef632c5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f5143e-66c5-4637-b754-ae72952cc5ae", "tag": "b30dc8d6-b194-432b-996f-a760a67504fc"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:59.436445 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-122e6805-ae55-43dd-ad30-545879a50a70 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:59.437750 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-122e6805-ae55-43dd-ad30-545879a50a70 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:59.443497 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-f128f785-7893-4f62-8e86-400415a35aa7 req-d437249c-f099-401a-8645-d92ef632c5bc service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:59.444004 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-f128f785-7893-4f62-8e86-400415a35aa7 req-d437249c-f099-401a-8645-d92ef632c5bc service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:59.450031 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-122e6805-ae55-43dd-ad30-545879a50a70 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:59.450492 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-122e6805-ae55-43dd-ad30-545879a50a70 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:59.451274 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-122e6805-ae55-43dd-ad30-545879a50a70 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:59.451709 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-122e6805-ae55-43dd-ad30-545879a50a70 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:59.457046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-f128f785-7893-4f62-8e86-400415a35aa7 req-d437249c-f099-401a-8645-d92ef632c5bc service nova] Creating event network-changed:b30dc8d6-b194-432b-996f-a760a67504fc for instance 25f5143e-66c5-4637-b754-ae72952cc5ae on hv-cinder-83588 May 10 16:51:59.463818 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-f128f785-7893-4f62-8e86-400415a35aa7 req-d437249c-f099-401a-8645-d92ef632c5bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042594 May 10 16:51:59.464676 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 238/501] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:51:59.708888 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-122e6805-ae55-43dd-ad30-545879a50a70 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:59.717579 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-122e6805-ae55-43dd-ad30-545879a50a70 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1760 microversion: 2.1 time: 0.290896 May 10 16:51:59.718643 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 264/502] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:51:59 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1760 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:01.740144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d0f11736-8edd-4840-8315-a450f20b06ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:01.741194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d0f11736-8edd-4840-8315-a450f20b06ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:01.747995 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d0f11736-8edd-4840-8315-a450f20b06ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:01.748481 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d0f11736-8edd-4840-8315-a450f20b06ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:01.749247 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d0f11736-8edd-4840-8315-a450f20b06ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:01.749714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d0f11736-8edd-4840-8315-a450f20b06ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:01.773309 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-d0f11736-8edd-4840-8315-a450f20b06ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lazy-loading 'flavor' on Instance uuid 061921a1-1ddc-4500-aee0-4cbeb018807f {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:52:01.899649 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d0f11736-8edd-4840-8315-a450f20b06ed tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/action" status: 200 len: 32 microversion: 2.1 time: 0.164286 May 10 16:52:01.900316 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 239/503] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:52:01 2022] POST /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:52:01.909876 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-39f3de0c-004c-40c4-9d40-34363377495b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:01.910630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-39f3de0c-004c-40c4-9d40-34363377495b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:01.917143 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39f3de0c-004c-40c4-9d40-34363377495b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:01.917688 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39f3de0c-004c-40c4-9d40-34363377495b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:01.918532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39f3de0c-004c-40c4-9d40-34363377495b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:01.918972 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-39f3de0c-004c-40c4-9d40-34363377495b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:02.207022 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-39f3de0c-004c-40c4-9d40-34363377495b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:02.222030 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-39f3de0c-004c-40c4-9d40-34363377495b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.316532 May 10 16:52:02.222633 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 265/504] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:01 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:02.267192 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a1496745-7924-4421-bbe6-76722f558e55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:02.267842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a1496745-7924-4421-bbe6-76722f558e55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:02.274326 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a1496745-7924-4421-bbe6-76722f558e55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:02.274806 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a1496745-7924-4421-bbe6-76722f558e55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:02.275634 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a1496745-7924-4421-bbe6-76722f558e55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:02.276098 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a1496745-7924-4421-bbe6-76722f558e55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:02.304568 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a1496745-7924-4421-bbe6-76722f558e55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:52:02.389159 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a1496745-7924-4421-bbe6-76722f558e55 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 204 len: 0 microversion: 2.1 time: 0.127256 May 10 16:52:02.393623 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 240/505] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:52:02 2022] DELETE /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:52:02.399419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a7b175dd-9f31-47d6-8fd7-580e99df1207 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:02.400094 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a7b175dd-9f31-47d6-8fd7-580e99df1207 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:02.406137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a7b175dd-9f31-47d6-8fd7-580e99df1207 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:02.406581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a7b175dd-9f31-47d6-8fd7-580e99df1207 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:02.407685 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a7b175dd-9f31-47d6-8fd7-580e99df1207 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:02.408301 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a7b175dd-9f31-47d6-8fd7-580e99df1207 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:02.539386 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a7b175dd-9f31-47d6-8fd7-580e99df1207 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:02.550327 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a7b175dd-9f31-47d6-8fd7-580e99df1207 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1513 microversion: 2.1 time: 0.154940 May 10 16:52:02.550973 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 266/506] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:02 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:03.240700 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-aa6b55d7-3727-4e27-9afd-733625c29b31 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:03.241400 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-aa6b55d7-3727-4e27-9afd-733625c29b31 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:03.247653 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aa6b55d7-3727-4e27-9afd-733625c29b31 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:03.248104 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aa6b55d7-3727-4e27-9afd-733625c29b31 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:03.248895 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aa6b55d7-3727-4e27-9afd-733625c29b31 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:03.249335 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aa6b55d7-3727-4e27-9afd-733625c29b31 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:03.379575 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-aa6b55d7-3727-4e27-9afd-733625c29b31 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:03.387432 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-aa6b55d7-3727-4e27-9afd-733625c29b31 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.150967 May 10 16:52:03.387994 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 241/507] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:03 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:03.567177 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-81fce0ce-b767-41d4-8c66-89e6e7eab6b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:03.567709 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-81fce0ce-b767-41d4-8c66-89e6e7eab6b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:03.574133 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-81fce0ce-b767-41d4-8c66-89e6e7eab6b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:03.574579 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-81fce0ce-b767-41d4-8c66-89e6e7eab6b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:03.575344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-81fce0ce-b767-41d4-8c66-89e6e7eab6b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:03.575775 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-81fce0ce-b767-41d4-8c66-89e6e7eab6b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:03.704254 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-81fce0ce-b767-41d4-8c66-89e6e7eab6b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:03.711608 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-81fce0ce-b767-41d4-8c66-89e6e7eab6b9 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1513 microversion: 2.1 time: 0.148428 May 10 16:52:03.712181 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 267/508] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:03 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:04.404675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-db488c42-0ab5-45b4-9da1-85a5aea6d7d7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:04.405287 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-db488c42-0ab5-45b4-9da1-85a5aea6d7d7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:04.412422 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-db488c42-0ab5-45b4-9da1-85a5aea6d7d7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:04.412874 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-db488c42-0ab5-45b4-9da1-85a5aea6d7d7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:04.413829 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-db488c42-0ab5-45b4-9da1-85a5aea6d7d7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:04.414432 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-db488c42-0ab5-45b4-9da1-85a5aea6d7d7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:04.556946 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-db488c42-0ab5-45b4-9da1-85a5aea6d7d7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:04.565399 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-db488c42-0ab5-45b4-9da1-85a5aea6d7d7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.164505 May 10 16:52:04.565969 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 242/509] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:04 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:04.729437 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0771ab76-85f4-4845-b62b-82143a164e8d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:04.730122 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0771ab76-85f4-4845-b62b-82143a164e8d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:04.738700 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0771ab76-85f4-4845-b62b-82143a164e8d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:04.739163 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0771ab76-85f4-4845-b62b-82143a164e8d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:04.739967 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0771ab76-85f4-4845-b62b-82143a164e8d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:04.740454 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0771ab76-85f4-4845-b62b-82143a164e8d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.036202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-0771ab76-85f4-4845-b62b-82143a164e8d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:05.043819 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0771ab76-85f4-4845-b62b-82143a164e8d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 200 len: 1513 microversion: 2.1 time: 0.318285 May 10 16:52:05.044611 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 268/510] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:04 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:05.253022 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-8b182556-82f5-49a2-920b-45edd1edff98 req-05b8e784-9db2-4d26-bf8b-e399dc991e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aecdb938-f6bb-4133-bbf8-f4b9645ce76a", "name": "network-vif-deleted", "tag": "c9672453-af7a-47d3-b2cc-46ead0204f1d"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:05.262253 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-8b182556-82f5-49a2-920b-45edd1edff98 req-05b8e784-9db2-4d26-bf8b-e399dc991e21 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.263271 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-8b182556-82f5-49a2-920b-45edd1edff98 req-05b8e784-9db2-4d26-bf8b-e399dc991e21 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.275200 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-8b182556-82f5-49a2-920b-45edd1edff98 req-05b8e784-9db2-4d26-bf8b-e399dc991e21 service nova] Creating event network-vif-deleted:c9672453-af7a-47d3-b2cc-46ead0204f1d for instance aecdb938-f6bb-4133-bbf8-f4b9645ce76a on hv-cinder-83588 May 10 16:52:05.281616 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-8b182556-82f5-49a2-920b-45edd1edff98 req-05b8e784-9db2-4d26-bf8b-e399dc991e21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031663 May 10 16:52:05.282267 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 243/511] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:05.583233 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-78ddd022-0f5e-4af2-a396-aeddda4e95ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:05.583842 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-78ddd022-0f5e-4af2-a396-aeddda4e95ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:05.590098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-78ddd022-0f5e-4af2-a396-aeddda4e95ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.590801 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-78ddd022-0f5e-4af2-a396-aeddda4e95ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.591722 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-78ddd022-0f5e-4af2-a396-aeddda4e95ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.592506 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-78ddd022-0f5e-4af2-a396-aeddda4e95ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.723666 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-78ddd022-0f5e-4af2-a396-aeddda4e95ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:05.731949 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-78ddd022-0f5e-4af2-a396-aeddda4e95ee tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.152561 May 10 16:52:05.732558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 269/512] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:05 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:06.062884 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7a81d912-2159-46b0-9285-ad6865594aaf tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:06.063650 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7a81d912-2159-46b0-9285-ad6865594aaf tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: aecdb938-f6bb-4133-bbf8-f4b9645ce76a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:06.070215 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7a81d912-2159-46b0-9285-ad6865594aaf tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:06.070662 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7a81d912-2159-46b0-9285-ad6865594aaf tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:06.071422 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7a81d912-2159-46b0-9285-ad6865594aaf tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:06.071862 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7a81d912-2159-46b0-9285-ad6865594aaf tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:06.087239 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-7a81d912-2159-46b0-9285-ad6865594aaf tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] HTTP exception thrown: Instance aecdb938-f6bb-4133-bbf8-f4b9645ce76a could not be found. May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7a81d912-2159-46b0-9285-ad6865594aaf tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Request method failure captured: May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a HTTP/1.1 May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepfPYlx1afomJHwrgVrfyn98mdKO4IaaUNX3oBiExz2ISfRJ0SmZ675D9GKm0iLsxN7-4PApL0GqilaYDIg6MOpKtcN_Gl9VFpiAL9r79yT-YHst3GBxWOQZzrc-tXd1BKF3UuPA1-nWYPMoW8Wq22nrWWMvjoq9kEJa1pBgeiZup9o May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: ea67afdf22fd4b41ac5f34bc29f3b7b8 May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1691006374 May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:52:06.088878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea67afdf22fd4b41ac5f34bc29f3b7b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea67afdf22fd4b41ac5f34bc29f3b7b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea67afdf22fd4b41ac5f34bc29f3b7b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea67afdf22fd4b41ac5f34bc29f3b7b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-VolumesSnapshotTestJSON-1691006374 May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: ea67afdf22fd4b41ac5f34bc29f3b7b8 May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1691006374 May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-VolumesSnapshotTestJSON-1691006374-project May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: dd61c2b29a8e448e9d18ac20959f3e1d May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-VolumesSnapshotTestJSON-1691006374-project May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance aecdb938-f6bb-4133-bbf8-f4b9645ce76a could not be found. May 10 16:52:06.090437 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': 'aecdb938-f6bb-4133-bbf8-f4b9645ce76a'} May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aecdb938-f6bb-4133-bbf8-f4b9645ce76a could not be found. May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:52:06.091444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aecdb938-f6bb-4133-bbf8-f4b9645ce76a could not be found. May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aecdb938-f6bb-4133-bbf8-f4b9645ce76a could not be found. May 10 16:52:06.092944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:06.094615 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7a81d912-2159-46b0-9285-ad6865594aaf tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Returning 404 to user: Instance aecdb938-f6bb-4133-bbf8-f4b9645ce76a could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:52:06.094615 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7a81d912-2159-46b0-9285-ad6865594aaf tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a" status: 404 len: 111 microversion: 2.1 time: 0.032015 May 10 16:52:06.094615 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 244/513] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:06 2022] GET /compute/v2.1/servers/aecdb938-f6bb-4133-bbf8-f4b9645ce76a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:52:06.749284 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-dda3cd82-af55-4f7c-a64a-2854161aa7e3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:06.750101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-dda3cd82-af55-4f7c-a64a-2854161aa7e3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:06.756464 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dda3cd82-af55-4f7c-a64a-2854161aa7e3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:06.756942 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dda3cd82-af55-4f7c-a64a-2854161aa7e3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:06.757702 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dda3cd82-af55-4f7c-a64a-2854161aa7e3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:06.758132 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dda3cd82-af55-4f7c-a64a-2854161aa7e3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:06.886759 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-dda3cd82-af55-4f7c-a64a-2854161aa7e3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:06.894545 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-dda3cd82-af55-4f7c-a64a-2854161aa7e3 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.149150 May 10 16:52:06.895103 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 270/514] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:06 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:07.911639 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d6bf8fbb-6e60-4539-8a0d-bbe932e4f5bb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:07.912492 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d6bf8fbb-6e60-4539-8a0d-bbe932e4f5bb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:07.918650 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d6bf8fbb-6e60-4539-8a0d-bbe932e4f5bb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:07.919107 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d6bf8fbb-6e60-4539-8a0d-bbe932e4f5bb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:07.919878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d6bf8fbb-6e60-4539-8a0d-bbe932e4f5bb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:07.920341 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d6bf8fbb-6e60-4539-8a0d-bbe932e4f5bb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:08.047978 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d6bf8fbb-6e60-4539-8a0d-bbe932e4f5bb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:08.056076 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d6bf8fbb-6e60-4539-8a0d-bbe932e4f5bb tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.148416 May 10 16:52:08.056670 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 245/515] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:07 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:09.074278 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-80afb22a-1dc7-4255-9a7f-f6e570e7c38b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:09.074872 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-80afb22a-1dc7-4255-9a7f-f6e570e7c38b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:09.082402 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-80afb22a-1dc7-4255-9a7f-f6e570e7c38b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:09.082920 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-80afb22a-1dc7-4255-9a7f-f6e570e7c38b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:09.083755 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-80afb22a-1dc7-4255-9a7f-f6e570e7c38b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:09.084297 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-80afb22a-1dc7-4255-9a7f-f6e570e7c38b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:09.213696 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-80afb22a-1dc7-4255-9a7f-f6e570e7c38b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:09.221717 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-80afb22a-1dc7-4255-9a7f-f6e570e7c38b tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.151294 May 10 16:52:09.222290 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 271/516] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:09 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:10.238999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-56adeb7d-51ed-4e4d-8e45-d74cbfc427ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:10.239691 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-56adeb7d-51ed-4e4d-8e45-d74cbfc427ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:10.246192 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56adeb7d-51ed-4e4d-8e45-d74cbfc427ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:10.246632 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56adeb7d-51ed-4e4d-8e45-d74cbfc427ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:10.247390 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56adeb7d-51ed-4e4d-8e45-d74cbfc427ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:10.247820 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56adeb7d-51ed-4e4d-8e45-d74cbfc427ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:10.383764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-56adeb7d-51ed-4e4d-8e45-d74cbfc427ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:10.392267 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-56adeb7d-51ed-4e4d-8e45-d74cbfc427ae tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.157453 May 10 16:52:10.392845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 246/517] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:10 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:11.409298 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-36785e33-4fc5-4cef-9617-edfae97a3653 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:11.409913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-36785e33-4fc5-4cef-9617-edfae97a3653 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:11.416258 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-36785e33-4fc5-4cef-9617-edfae97a3653 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:11.416740 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-36785e33-4fc5-4cef-9617-edfae97a3653 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:11.417515 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-36785e33-4fc5-4cef-9617-edfae97a3653 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:11.417957 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-36785e33-4fc5-4cef-9617-edfae97a3653 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:11.546166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-36785e33-4fc5-4cef-9617-edfae97a3653 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:11.554846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-36785e33-4fc5-4cef-9617-edfae97a3653 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.149980 May 10 16:52:11.555419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 272/518] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:11 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:12.571393 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f54204a9-c3a2-4e5b-8b63-b10b6f08e908 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:12.572013 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f54204a9-c3a2-4e5b-8b63-b10b6f08e908 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:12.579559 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f54204a9-c3a2-4e5b-8b63-b10b6f08e908 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:12.580026 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f54204a9-c3a2-4e5b-8b63-b10b6f08e908 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:12.580842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f54204a9-c3a2-4e5b-8b63-b10b6f08e908 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:12.581286 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f54204a9-c3a2-4e5b-8b63-b10b6f08e908 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:12.708644 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f54204a9-c3a2-4e5b-8b63-b10b6f08e908 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:12.716533 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f54204a9-c3a2-4e5b-8b63-b10b6f08e908 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.148935 May 10 16:52:12.717032 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 247/519] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:12 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:13.733736 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7a4109ac-d958-46c3-8c8a-3935f8c1fa52 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:13.734262 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7a4109ac-d958-46c3-8c8a-3935f8c1fa52 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:13.741543 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a4109ac-d958-46c3-8c8a-3935f8c1fa52 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:13.741999 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a4109ac-d958-46c3-8c8a-3935f8c1fa52 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:13.742772 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a4109ac-d958-46c3-8c8a-3935f8c1fa52 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:13.743217 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a4109ac-d958-46c3-8c8a-3935f8c1fa52 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:13.881025 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7a4109ac-d958-46c3-8c8a-3935f8c1fa52 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:13.888872 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7a4109ac-d958-46c3-8c8a-3935f8c1fa52 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.159111 May 10 16:52:13.889450 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 273/520] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:13 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:13.907105 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1468816210", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "networks": [{"uuid": "86c89ebc-58b3-49c4-b16f-4293e1e93d33"}]}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:13.958247 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] validate_networks() for [('86c89ebc-58b3-49c4-b16f-4293e1e93d33', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:52:14.299436 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:52:14.299864 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:52:14.300627 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:52:14.301036 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:52:14.301446 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:52:14.310017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:14.310466 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:14.311262 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:14.311697 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:14.327672 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Getting quotas for project ea67afdf22fd4b41ac5f34bc29f3b7b8. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:52:14.331677 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Getting quotas for user dd61c2b29a8e448e9d18ac20959f3e1d and project ea67afdf22fd4b41ac5f34bc29f3b7b8. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:52:14.348660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:52:14.350904 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:52:14.399651 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-03fe0768-d29d-4ad2-93cc-55387bdeee5f tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496277 May 10 16:52:14.400305 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 248/521] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:52:14.410683 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9120910f-5365-47b5-8ac5-3aa4791af893 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:14.411288 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9120910f-5365-47b5-8ac5-3aa4791af893 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:14.463131 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9120910f-5365-47b5-8ac5-3aa4791af893 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:14.470394 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9120910f-5365-47b5-8ac5-3aa4791af893 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1219 microversion: 2.1 time: 0.063548 May 10 16:52:14.471170 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 274/522] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:14 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:14.906395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-618c77cf-d1b0-4c68-bc06-5e2ebc468fb8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:14.906999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-618c77cf-d1b0-4c68-bc06-5e2ebc468fb8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:14.914645 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-618c77cf-d1b0-4c68-bc06-5e2ebc468fb8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:14.915647 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-618c77cf-d1b0-4c68-bc06-5e2ebc468fb8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:14.915864 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-618c77cf-d1b0-4c68-bc06-5e2ebc468fb8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:14.916331 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-618c77cf-d1b0-4c68-bc06-5e2ebc468fb8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:15.068671 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-618c77cf-d1b0-4c68-bc06-5e2ebc468fb8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:15.082250 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-618c77cf-d1b0-4c68-bc06-5e2ebc468fb8 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.179611 May 10 16:52:15.082894 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 249/523] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:14 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:15.486943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6e52da58-45e9-484d-87a2-2c7de9ee18a0 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:15.487537 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6e52da58-45e9-484d-87a2-2c7de9ee18a0 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:15.493660 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6e52da58-45e9-484d-87a2-2c7de9ee18a0 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:15.494330 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6e52da58-45e9-484d-87a2-2c7de9ee18a0 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:15.495121 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6e52da58-45e9-484d-87a2-2c7de9ee18a0 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:15.495564 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6e52da58-45e9-484d-87a2-2c7de9ee18a0 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:15.600615 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6e52da58-45e9-484d-87a2-2c7de9ee18a0 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:15.608036 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6e52da58-45e9-484d-87a2-2c7de9ee18a0 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1289 microversion: 2.1 time: 0.124930 May 10 16:52:15.608693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 275/524] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:15 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:16.099877 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8abe98aa-923d-40fd-9054-73b6c13b7fd1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:16.100674 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8abe98aa-923d-40fd-9054-73b6c13b7fd1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:16.107348 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8abe98aa-923d-40fd-9054-73b6c13b7fd1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:16.107897 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8abe98aa-923d-40fd-9054-73b6c13b7fd1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:16.108792 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8abe98aa-923d-40fd-9054-73b6c13b7fd1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:16.109304 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8abe98aa-923d-40fd-9054-73b6c13b7fd1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:16.253180 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8abe98aa-923d-40fd-9054-73b6c13b7fd1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:16.261240 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8abe98aa-923d-40fd-9054-73b6c13b7fd1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.165998 May 10 16:52:16.261829 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 250/525] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:16 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:16.626532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-fed6763d-ddee-40d7-8967-9e5dfef177c1 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:16.627155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-fed6763d-ddee-40d7-8967-9e5dfef177c1 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:16.633647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fed6763d-ddee-40d7-8967-9e5dfef177c1 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:16.634097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fed6763d-ddee-40d7-8967-9e5dfef177c1 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:16.634882 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fed6763d-ddee-40d7-8967-9e5dfef177c1 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:16.635320 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fed6763d-ddee-40d7-8967-9e5dfef177c1 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:16.850400 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-fed6763d-ddee-40d7-8967-9e5dfef177c1 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:16.858293 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-fed6763d-ddee-40d7-8967-9e5dfef177c1 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1319 microversion: 2.1 time: 0.235537 May 10 16:52:16.859275 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 276/526] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:16 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:16.870285 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-279b46e5-faac-4c21-9d82-b115d7de8702 req-2ca9f1a5-f594-438e-864f-972fec55b9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c8deb8-8525-4818-a322-888512260d7a", "tag": "9b019ea1-4c69-432b-9c7a-818601fff78a"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:16.881552 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-279b46e5-faac-4c21-9d82-b115d7de8702 req-2ca9f1a5-f594-438e-864f-972fec55b9a0 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:16.882009 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-279b46e5-faac-4c21-9d82-b115d7de8702 req-2ca9f1a5-f594-438e-864f-972fec55b9a0 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:16.897643 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-279b46e5-faac-4c21-9d82-b115d7de8702 req-2ca9f1a5-f594-438e-864f-972fec55b9a0 service nova] Creating event network-changed:9b019ea1-4c69-432b-9c7a-818601fff78a for instance b5c8deb8-8525-4818-a322-888512260d7a on hv-cinder-83588 May 10 16:52:16.902773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-279b46e5-faac-4c21-9d82-b115d7de8702 req-2ca9f1a5-f594-438e-864f-972fec55b9a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037676 May 10 16:52:16.903396 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 251/527] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:17.279003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5a3445ca-eeb7-4356-85f2-418116dd21d2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:17.279531 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-5a3445ca-eeb7-4356-85f2-418116dd21d2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:17.285461 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a3445ca-eeb7-4356-85f2-418116dd21d2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:17.285909 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a3445ca-eeb7-4356-85f2-418116dd21d2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:17.286685 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a3445ca-eeb7-4356-85f2-418116dd21d2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:17.287124 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a3445ca-eeb7-4356-85f2-418116dd21d2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:17.422767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5a3445ca-eeb7-4356-85f2-418116dd21d2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:17.431399 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5a3445ca-eeb7-4356-85f2-418116dd21d2 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.156303 May 10 16:52:17.431977 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 277/528] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:17 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:17.877983 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-732a076e-44c8-44e5-983a-7aaf9d018ab5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:17.878679 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-732a076e-44c8-44e5-983a-7aaf9d018ab5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:17.884993 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-732a076e-44c8-44e5-983a-7aaf9d018ab5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:17.885447 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-732a076e-44c8-44e5-983a-7aaf9d018ab5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:17.886225 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-732a076e-44c8-44e5-983a-7aaf9d018ab5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:17.886667 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-732a076e-44c8-44e5-983a-7aaf9d018ab5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:18.025739 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-732a076e-44c8-44e5-983a-7aaf9d018ab5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:18.033156 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-732a076e-44c8-44e5-983a-7aaf9d018ab5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1319 microversion: 2.1 time: 0.160362 May 10 16:52:18.033743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 252/529] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:17 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:18.447773 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-681ededf-0bc3-424c-92bb-2b4fcae7bc98 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:18.448416 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-681ededf-0bc3-424c-92bb-2b4fcae7bc98 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:18.455118 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-681ededf-0bc3-424c-92bb-2b4fcae7bc98 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:18.455623 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-681ededf-0bc3-424c-92bb-2b4fcae7bc98 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:18.456450 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-681ededf-0bc3-424c-92bb-2b4fcae7bc98 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:18.457043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-681ededf-0bc3-424c-92bb-2b4fcae7bc98 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:18.660025 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-681ededf-0bc3-424c-92bb-2b4fcae7bc98 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:18.668234 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-681ededf-0bc3-424c-92bb-2b4fcae7bc98 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.224457 May 10 16:52:18.668849 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 278/530] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:18 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:19.050317 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-209df561-3c0b-44ee-8aeb-8002730bbae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:19.050930 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-209df561-3c0b-44ee-8aeb-8002730bbae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:19.058205 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-209df561-3c0b-44ee-8aeb-8002730bbae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:19.058668 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-209df561-3c0b-44ee-8aeb-8002730bbae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:19.059462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-209df561-3c0b-44ee-8aeb-8002730bbae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:19.059901 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-209df561-3c0b-44ee-8aeb-8002730bbae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:19.195398 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-209df561-3c0b-44ee-8aeb-8002730bbae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:19.202663 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-209df561-3c0b-44ee-8aeb-8002730bbae4 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1319 microversion: 2.1 time: 0.156514 May 10 16:52:19.203226 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 253/531] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:19 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:19.686428 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6a6ef42b-fe6d-43d6-b245-c0d973dbe454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:19.687019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6a6ef42b-fe6d-43d6-b245-c0d973dbe454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:19.694146 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a6ef42b-fe6d-43d6-b245-c0d973dbe454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:19.694857 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a6ef42b-fe6d-43d6-b245-c0d973dbe454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:19.695856 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a6ef42b-fe6d-43d6-b245-c0d973dbe454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:19.696319 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a6ef42b-fe6d-43d6-b245-c0d973dbe454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:19.826267 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6a6ef42b-fe6d-43d6-b245-c0d973dbe454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:19.834363 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6a6ef42b-fe6d-43d6-b245-c0d973dbe454 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.151797 May 10 16:52:19.834893 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 279/532] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:19 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:20.220529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-61a5a191-abe8-4d49-8b9c-4ccfcae5ccc6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:20.221136 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-61a5a191-abe8-4d49-8b9c-4ccfcae5ccc6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:20.227410 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-61a5a191-abe8-4d49-8b9c-4ccfcae5ccc6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:20.227859 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-61a5a191-abe8-4d49-8b9c-4ccfcae5ccc6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:20.228651 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-61a5a191-abe8-4d49-8b9c-4ccfcae5ccc6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:20.229077 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-61a5a191-abe8-4d49-8b9c-4ccfcae5ccc6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:20.356902 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-61a5a191-abe8-4d49-8b9c-4ccfcae5ccc6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:20.365316 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-61a5a191-abe8-4d49-8b9c-4ccfcae5ccc6 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1319 microversion: 2.1 time: 0.149149 May 10 16:52:20.365907 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 254/533] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:20 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:20.850980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0efb521d-5813-4139-9548-757ef45f2ebe tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:20.851585 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0efb521d-5813-4139-9548-757ef45f2ebe tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:20.857939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0efb521d-5813-4139-9548-757ef45f2ebe tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:20.858394 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0efb521d-5813-4139-9548-757ef45f2ebe tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:20.859163 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0efb521d-5813-4139-9548-757ef45f2ebe tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:20.859600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0efb521d-5813-4139-9548-757ef45f2ebe tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:21.023822 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-0efb521d-5813-4139-9548-757ef45f2ebe tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:21.031713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0efb521d-5813-4139-9548-757ef45f2ebe tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.184550 May 10 16:52:21.032408 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 280/534] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:20 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:21.382360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d2cc4c8b-f4eb-4f36-bef7-96ae3990d55d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:21.382976 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d2cc4c8b-f4eb-4f36-bef7-96ae3990d55d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:21.389076 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d2cc4c8b-f4eb-4f36-bef7-96ae3990d55d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:21.389543 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d2cc4c8b-f4eb-4f36-bef7-96ae3990d55d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:21.390323 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d2cc4c8b-f4eb-4f36-bef7-96ae3990d55d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:21.390764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d2cc4c8b-f4eb-4f36-bef7-96ae3990d55d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:21.534744 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d2cc4c8b-f4eb-4f36-bef7-96ae3990d55d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:21.543054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d2cc4c8b-f4eb-4f36-bef7-96ae3990d55d tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1319 microversion: 2.1 time: 0.164630 May 10 16:52:21.543640 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 255/535] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:21 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:22.049251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a26b7538-6a85-4608-ac54-2c288b6d2ae0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:22.049793 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a26b7538-6a85-4608-ac54-2c288b6d2ae0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:22.056083 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a26b7538-6a85-4608-ac54-2c288b6d2ae0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:22.056656 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a26b7538-6a85-4608-ac54-2c288b6d2ae0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:22.057459 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a26b7538-6a85-4608-ac54-2c288b6d2ae0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:22.057896 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a26b7538-6a85-4608-ac54-2c288b6d2ae0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:22.188223 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a26b7538-6a85-4608-ac54-2c288b6d2ae0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:22.195988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a26b7538-6a85-4608-ac54-2c288b6d2ae0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1737 microversion: 2.1 time: 0.150819 May 10 16:52:22.196584 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 281/536] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:22 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:22.562457 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0ae770c7-2b45-4acd-b5f0-6f987fa5201a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:22.563725 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0ae770c7-2b45-4acd-b5f0-6f987fa5201a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:22.570149 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0ae770c7-2b45-4acd-b5f0-6f987fa5201a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:22.570595 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0ae770c7-2b45-4acd-b5f0-6f987fa5201a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:22.571383 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0ae770c7-2b45-4acd-b5f0-6f987fa5201a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:22.571828 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0ae770c7-2b45-4acd-b5f0-6f987fa5201a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:22.704571 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0ae770c7-2b45-4acd-b5f0-6f987fa5201a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:22.711748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0ae770c7-2b45-4acd-b5f0-6f987fa5201a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1319 microversion: 2.1 time: 0.153127 May 10 16:52:22.712329 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 256/537] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:22 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:23.213994 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-365aa1cf-2ea1-477f-b42a-1e52446674b0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:23.214632 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-365aa1cf-2ea1-477f-b42a-1e52446674b0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:23.221379 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-365aa1cf-2ea1-477f-b42a-1e52446674b0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.221834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-365aa1cf-2ea1-477f-b42a-1e52446674b0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.222618 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-365aa1cf-2ea1-477f-b42a-1e52446674b0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.223050 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-365aa1cf-2ea1-477f-b42a-1e52446674b0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.341185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-57e93100-a9fb-4ecc-8820-3e5182ffe95b req-d37f692a-4172-4147-9d6e-2ae9d7b94ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c8deb8-8525-4818-a322-888512260d7a", "name": "network-vif-plugged", "status": "completed", "tag": "9b019ea1-4c69-432b-9c7a-818601fff78a"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:23.350366 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-57e93100-a9fb-4ecc-8820-3e5182ffe95b req-d37f692a-4172-4147-9d6e-2ae9d7b94ced service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.350782 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-57e93100-a9fb-4ecc-8820-3e5182ffe95b req-d37f692a-4172-4147-9d6e-2ae9d7b94ced service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.359486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-365aa1cf-2ea1-477f-b42a-1e52446674b0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:23.363723 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-57e93100-a9fb-4ecc-8820-3e5182ffe95b req-d37f692a-4172-4147-9d6e-2ae9d7b94ced service nova] Creating event network-vif-plugged:9b019ea1-4c69-432b-9c7a-818601fff78a for instance b5c8deb8-8525-4818-a322-888512260d7a on hv-cinder-83588 May 10 16:52:23.368778 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-57e93100-a9fb-4ecc-8820-3e5182ffe95b req-d37f692a-4172-4147-9d6e-2ae9d7b94ced service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 May 10 16:52:23.369558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 257/538] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:52:23.369799 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-365aa1cf-2ea1-477f-b42a-1e52446674b0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1717 microversion: 2.1 time: 0.159635 May 10 16:52:23.370382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 282/539] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:23 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:52:23.479456 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0d23fc32-a9b1-4f82-a5e7-f9cc3c692e87 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:23.480059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0d23fc32-a9b1-4f82-a5e7-f9cc3c692e87 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:23.486895 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0d23fc32-a9b1-4f82-a5e7-f9cc3c692e87 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.487283 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0d23fc32-a9b1-4f82-a5e7-f9cc3c692e87 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.488069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0d23fc32-a9b1-4f82-a5e7-f9cc3c692e87 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.488506 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0d23fc32-a9b1-4f82-a5e7-f9cc3c692e87 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.616406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-0d23fc32-a9b1-4f82-a5e7-f9cc3c692e87 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] HTTP exception thrown: Cannot 'detach_volume' instance 061921a1-1ddc-4500-aee0-4cbeb018807f while it is in vm_state rescued May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0d23fc32-a9b1-4f82-a5e7-f9cc3c692e87 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Request method failure captured: May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: DELETE /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments/36421dfd-323a-4180-852b-3fd5f5052a5a HTTP/1.1 May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepdJR-AF-Z26xVSih2S5pNsgUpMA9h2-Krw7RrRj8d_QVb-3P4O9A7qASBY6YcTvAlFWYfInVgEslcfuVTs_Qnhf8VRyTXZHu6Hjtdi2GX-INLheW4fBj5cu-AnpIf8NHny2CNDo-adluifJHsQB9ZA56KGMRy71THEq-fiRgcDf_ec May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: f6208c73932343aeae12d8cd0983fc77 May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:52:23.618054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: f6208c73932343aeae12d8cd0983fc77 May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-ServerRescueNegativeTestJSON-1478239847-project May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 4de0f4da2d2e464fb9501fa58e344bed May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478239847-project May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:52:23.619617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Cannot 'detach_volume' instance 061921a1-1ddc-4500-aee0-4cbeb018807f while it is in vm_state rescued May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'server_id': '061921a1-1ddc-4500-aee0-4cbeb018807f', 'id': '36421dfd-323a-4180-852b-3fd5f5052a5a'} May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 061921a1-1ddc-4500-aee0-4cbeb018807f in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:52:23.620440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 061921a1-1ddc-4500-aee0-4cbeb018807f while it is in vm_state rescued May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 061921a1-1ddc-4500-aee0-4cbeb018807f while it is in vm_state rescued May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:23.621822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0d23fc32-a9b1-4f82-a5e7-f9cc3c692e87 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Returning 409 to user: Cannot 'detach_volume' instance 061921a1-1ddc-4500-aee0-4cbeb018807f while it is in vm_state rescued {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:52:23.622973 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0d23fc32-a9b1-4f82-a5e7-f9cc3c692e87 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "DELETE /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments/36421dfd-323a-4180-852b-3fd5f5052a5a" status: 409 len: 152 microversion: 2.1 time: 0.144398 May 10 16:52:23.622973 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 258/540] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:52:23 2022] DELETE /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments/36421dfd-323a-4180-852b-3fd5f5052a5a => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 16:52:23.628668 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-acbdbe24-da1e-4e12-a2d4-0984180a3d11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:23.629203 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-acbdbe24-da1e-4e12-a2d4-0984180a3d11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:23.635108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-acbdbe24-da1e-4e12-a2d4-0984180a3d11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.635570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-acbdbe24-da1e-4e12-a2d4-0984180a3d11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.636368 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-acbdbe24-da1e-4e12-a2d4-0984180a3d11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.636809 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-acbdbe24-da1e-4e12-a2d4-0984180a3d11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.702541 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-acbdbe24-da1e-4e12-a2d4-0984180a3d11 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "POST /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/action" status: 202 len: 0 microversion: 2.1 time: 0.077929 May 10 16:52:23.703187 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 283/541] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:52:23 2022] POST /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:52:23.712556 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-947f5d44-9be8-4193-b84a-15b2645616bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:23.713175 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-947f5d44-9be8-4193-b84a-15b2645616bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:23.719187 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-947f5d44-9be8-4193-b84a-15b2645616bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.720357 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-947f5d44-9be8-4193-b84a-15b2645616bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.721281 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-947f5d44-9be8-4193-b84a-15b2645616bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.721723 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-947f5d44-9be8-4193-b84a-15b2645616bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.728856 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a4d8845d-e184-4691-a0aa-40016d5eb744 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:23.729590 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a4d8845d-e184-4691-a0aa-40016d5eb744 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:23.736288 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a4d8845d-e184-4691-a0aa-40016d5eb744 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.736762 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a4d8845d-e184-4691-a0aa-40016d5eb744 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.737546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a4d8845d-e184-4691-a0aa-40016d5eb744 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:23.737994 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a4d8845d-e184-4691-a0aa-40016d5eb744 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:23.855778 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-947f5d44-9be8-4193-b84a-15b2645616bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:23.865115 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-947f5d44-9be8-4193-b84a-15b2645616bc tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1725 microversion: 2.1 time: 0.156980 May 10 16:52:23.865783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 259/542] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:23 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:23.873028 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a4d8845d-e184-4691-a0aa-40016d5eb744 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:23.881390 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a4d8845d-e184-4691-a0aa-40016d5eb744 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1319 microversion: 2.1 time: 0.156793 May 10 16:52:23.881966 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 284/543] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:23 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:52:24.882086 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e6504357-b926-4877-8213-e0c478c4e2c9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:24.882696 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e6504357-b926-4877-8213-e0c478c4e2c9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:24.888963 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e6504357-b926-4877-8213-e0c478c4e2c9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:24.889406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e6504357-b926-4877-8213-e0c478c4e2c9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:24.890164 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e6504357-b926-4877-8213-e0c478c4e2c9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:24.890598 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e6504357-b926-4877-8213-e0c478c4e2c9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:24.898655 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1abe8666-b31d-4c28-bed3-c5e4a89efe96 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:24.899261 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1abe8666-b31d-4c28-bed3-c5e4a89efe96 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:24.905605 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1abe8666-b31d-4c28-bed3-c5e4a89efe96 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:24.906056 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1abe8666-b31d-4c28-bed3-c5e4a89efe96 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:24.906969 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1abe8666-b31d-4c28-bed3-c5e4a89efe96 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:24.907490 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1abe8666-b31d-4c28-bed3-c5e4a89efe96 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:25.022980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e6504357-b926-4877-8213-e0c478c4e2c9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:25.030764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e6504357-b926-4877-8213-e0c478c4e2c9 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1725 microversion: 2.1 time: 0.152476 May 10 16:52:25.031332 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 260/544] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:24 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:25.041439 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1abe8666-b31d-4c28-bed3-c5e4a89efe96 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:25.049269 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1abe8666-b31d-4c28-bed3-c5e4a89efe96 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1319 microversion: 2.1 time: 0.154422 May 10 16:52:25.049829 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 285/545] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:24 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:52:26.049024 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-fdbff4a3-52e2-4dfc-b41f-a47a9c9d6c34 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:26.049625 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-fdbff4a3-52e2-4dfc-b41f-a47a9c9d6c34 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:26.056170 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fdbff4a3-52e2-4dfc-b41f-a47a9c9d6c34 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:26.056654 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fdbff4a3-52e2-4dfc-b41f-a47a9c9d6c34 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:26.057415 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fdbff4a3-52e2-4dfc-b41f-a47a9c9d6c34 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:26.057845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fdbff4a3-52e2-4dfc-b41f-a47a9c9d6c34 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:26.066954 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2dceedf7-3dd3-4cb4-9a8c-0ff8ab21151a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:26.067566 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2dceedf7-3dd3-4cb4-9a8c-0ff8ab21151a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:26.073911 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2dceedf7-3dd3-4cb4-9a8c-0ff8ab21151a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:26.074365 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2dceedf7-3dd3-4cb4-9a8c-0ff8ab21151a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:26.075131 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2dceedf7-3dd3-4cb4-9a8c-0ff8ab21151a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:26.075569 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2dceedf7-3dd3-4cb4-9a8c-0ff8ab21151a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:26.186549 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-fdbff4a3-52e2-4dfc-b41f-a47a9c9d6c34 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:26.194612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-fdbff4a3-52e2-4dfc-b41f-a47a9c9d6c34 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1725 microversion: 2.1 time: 0.150008 May 10 16:52:26.195186 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 261/546] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:26 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:26.203519 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2dceedf7-3dd3-4cb4-9a8c-0ff8ab21151a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:26.211527 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2dceedf7-3dd3-4cb4-9a8c-0ff8ab21151a tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1507 microversion: 2.1 time: 0.149163 May 10 16:52:26.212094 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 286/547] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:26 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:52:26.228334 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a80e7675-ba7a-47f9-aba4-4b1a3aa19a41 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6d4267e-3b0c-4ef1-9ec0-e7f6046ec53f", "device": "/dev/sdb"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:26.229488 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a80e7675-ba7a-47f9-aba4-4b1a3aa19a41 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:26.236229 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a80e7675-ba7a-47f9-aba4-4b1a3aa19a41 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:26.236707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a80e7675-ba7a-47f9-aba4-4b1a3aa19a41 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:26.237479 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a80e7675-ba7a-47f9-aba4-4b1a3aa19a41 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:26.237918 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a80e7675-ba7a-47f9-aba4-4b1a3aa19a41 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:27.200763 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a80e7675-ba7a-47f9-aba4-4b1a3aa19a41 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "POST /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.976128 May 10 16:52:27.202230 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 262/548] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:52:26 2022] POST /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a/os-volume_attachments => generated 194 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:27.210930 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-797be546-f6db-431c-9faf-b6a6cf2b0805 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:27.211623 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-797be546-f6db-431c-9faf-b6a6cf2b0805 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:27.218176 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-797be546-f6db-431c-9faf-b6a6cf2b0805 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:27.218632 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-797be546-f6db-431c-9faf-b6a6cf2b0805 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:27.220506 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-797be546-f6db-431c-9faf-b6a6cf2b0805 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:27.220868 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-797be546-f6db-431c-9faf-b6a6cf2b0805 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:27.370104 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-797be546-f6db-431c-9faf-b6a6cf2b0805 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:27.378213 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-797be546-f6db-431c-9faf-b6a6cf2b0805 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1725 microversion: 2.1 time: 0.171116 May 10 16:52:27.378785 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 287/549] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:27 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:28.395351 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-25236697-4b3a-4654-974c-5ebc3796d72e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:28.396080 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-25236697-4b3a-4654-974c-5ebc3796d72e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:28.402206 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-25236697-4b3a-4654-974c-5ebc3796d72e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:28.402656 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-25236697-4b3a-4654-974c-5ebc3796d72e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:28.403418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-25236697-4b3a-4654-974c-5ebc3796d72e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:28.403853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-25236697-4b3a-4654-974c-5ebc3796d72e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:28.534455 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-25236697-4b3a-4654-974c-5ebc3796d72e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:28.542293 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-25236697-4b3a-4654-974c-5ebc3796d72e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1731 microversion: 2.1 time: 0.151587 May 10 16:52:28.542791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 263/550] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:28 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:28.559178 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-fb3c786b-d81a-4c8d-adb4-9166c209b617 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:28.559664 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-fb3c786b-d81a-4c8d-adb4-9166c209b617 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:28.565919 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fb3c786b-d81a-4c8d-adb4-9166c209b617 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:28.566371 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fb3c786b-d81a-4c8d-adb4-9166c209b617 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:28.567154 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fb3c786b-d81a-4c8d-adb4-9166c209b617 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:28.567572 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fb3c786b-d81a-4c8d-adb4-9166c209b617 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:28.646589 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-fb3c786b-d81a-4c8d-adb4-9166c209b617 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091140 May 10 16:52:28.647221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 288/551] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 10 16:52:28 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:52:29.815691 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-a5b73717-d412-469b-847b-2fe7ef11b96f req-fb2620fd-727e-4416-bd76-3648e04e5d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061921a1-1ddc-4500-aee0-4cbeb018807f", "tag": "01f7d055-f780-49f6-98a2-68c108a3aa05"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:29.824090 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-a5b73717-d412-469b-847b-2fe7ef11b96f req-fb2620fd-727e-4416-bd76-3648e04e5d7e service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:29.824539 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-a5b73717-d412-469b-847b-2fe7ef11b96f req-fb2620fd-727e-4416-bd76-3648e04e5d7e service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:29.835997 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-a5b73717-d412-469b-847b-2fe7ef11b96f req-fb2620fd-727e-4416-bd76-3648e04e5d7e service nova] Creating event network-changed:01f7d055-f780-49f6-98a2-68c108a3aa05 for instance 061921a1-1ddc-4500-aee0-4cbeb018807f on hv-cinder-83588 May 10 16:52:29.840745 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-a5b73717-d412-469b-847b-2fe7ef11b96f req-fb2620fd-727e-4416-bd76-3648e04e5d7e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028784 May 10 16:52:29.841488 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 264/552] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:30.032703 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d70aff63-e22e-4fda-9e6e-d7395f2ca786 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:30.033251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d70aff63-e22e-4fda-9e6e-d7395f2ca786 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:30.039586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d70aff63-e22e-4fda-9e6e-d7395f2ca786 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:30.039786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d70aff63-e22e-4fda-9e6e-d7395f2ca786 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:30.040640 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d70aff63-e22e-4fda-9e6e-d7395f2ca786 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:30.041079 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d70aff63-e22e-4fda-9e6e-d7395f2ca786 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:30.070618 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d70aff63-e22e-4fda-9e6e-d7395f2ca786 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments/27e4a353-dab6-42db-b6f1-5d6622ab3121" status: 200 len: 194 microversion: 2.20 time: 0.042755 May 10 16:52:30.071419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 289/553] 10.222.0.48 () {60 vars in 1453 bytes} [Tue May 10 16:52:30 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments/27e4a353-dab6-42db-b6f1-5d6622ab3121 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:52:30.151307 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5cd22846-fece-4b88-80f5-8be364f511a5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:30.152006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5cd22846-fece-4b88-80f5-8be364f511a5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:30.159779 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5cd22846-fece-4b88-80f5-8be364f511a5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:30.160258 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5cd22846-fece-4b88-80f5-8be364f511a5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:30.161180 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5cd22846-fece-4b88-80f5-8be364f511a5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:30.161746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5cd22846-fece-4b88-80f5-8be364f511a5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:30.247372 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-5cd22846-fece-4b88-80f5-8be364f511a5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lazy-loading 'services' on Instance uuid c6739110-4e68-4993-83ec-7c1503f7b87b {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:52:30.378535 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-5cd22846-fece-4b88-80f5-8be364f511a5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments/27e4a353-dab6-42db-b6f1-5d6622ab3121" status: 202 len: 0 microversion: 2.20 time: 0.231051 May 10 16:52:30.383216 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 265/554] 10.222.0.48 () {60 vars in 1456 bytes} [Tue May 10 16:52:30 2022] DELETE /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments/27e4a353-dab6-42db-b6f1-5d6622ab3121 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 16:52:30.387752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-02d9e048-b07e-4bd0-b08b-000de1b37d29 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:30.388763 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-02d9e048-b07e-4bd0-b08b-000de1b37d29 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:30.397346 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02d9e048-b07e-4bd0-b08b-000de1b37d29 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:30.397990 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02d9e048-b07e-4bd0-b08b-000de1b37d29 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:30.398964 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02d9e048-b07e-4bd0-b08b-000de1b37d29 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:30.399742 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02d9e048-b07e-4bd0-b08b-000de1b37d29 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:30.445393 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-02d9e048-b07e-4bd0-b08b-000de1b37d29 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061585 May 10 16:52:30.445976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 290/555] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 10 16:52:30 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:52:31.459136 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e52ff421-559f-44d2-977d-7e36c862da65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:31.460178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e52ff421-559f-44d2-977d-7e36c862da65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:31.466338 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e52ff421-559f-44d2-977d-7e36c862da65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:31.466789 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e52ff421-559f-44d2-977d-7e36c862da65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:31.467560 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e52ff421-559f-44d2-977d-7e36c862da65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:31.468031 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e52ff421-559f-44d2-977d-7e36c862da65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:31.498330 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e52ff421-559f-44d2-977d-7e36c862da65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044573 May 10 16:52:31.498884 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 266/556] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 10 16:52:31 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:52:31.579040 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0aef05f0-5406-42e9-bcd0-d00c1105d12f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:31.579992 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0aef05f0-5406-42e9-bcd0-d00c1105d12f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:31.586352 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0aef05f0-5406-42e9-bcd0-d00c1105d12f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:31.586804 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0aef05f0-5406-42e9-bcd0-d00c1105d12f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:31.587575 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0aef05f0-5406-42e9-bcd0-d00c1105d12f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:31.588012 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0aef05f0-5406-42e9-bcd0-d00c1105d12f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:31.660538 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0aef05f0-5406-42e9-bcd0-d00c1105d12f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "POST /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.085311 May 10 16:52:31.661180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 291/557] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:52:31 2022] POST /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:52:31.671044 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3df5aa93-459a-4bcf-b517-007aada1aeb9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:31.671657 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3df5aa93-459a-4bcf-b517-007aada1aeb9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:31.678842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3df5aa93-459a-4bcf-b517-007aada1aeb9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:31.679292 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3df5aa93-459a-4bcf-b517-007aada1aeb9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:31.680090 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3df5aa93-459a-4bcf-b517-007aada1aeb9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:31.680563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3df5aa93-459a-4bcf-b517-007aada1aeb9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:31.834945 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3df5aa93-459a-4bcf-b517-007aada1aeb9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:31.842730 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3df5aa93-459a-4bcf-b517-007aada1aeb9 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1752 microversion: 2.1 time: 0.176478 May 10 16:52:31.843310 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 267/558] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:31 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:31.855463 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-4550f08f-524e-41e5-875d-2b7dd900e6c4 req-f3d31e32-a95a-4d0a-8fc1-ac25ecc44787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061921a1-1ddc-4500-aee0-4cbeb018807f", "tag": "01f7d055-f780-49f6-98a2-68c108a3aa05"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:31.863886 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-4550f08f-524e-41e5-875d-2b7dd900e6c4 req-f3d31e32-a95a-4d0a-8fc1-ac25ecc44787 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:31.864356 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-4550f08f-524e-41e5-875d-2b7dd900e6c4 req-f3d31e32-a95a-4d0a-8fc1-ac25ecc44787 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:31.875409 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-4550f08f-524e-41e5-875d-2b7dd900e6c4 req-f3d31e32-a95a-4d0a-8fc1-ac25ecc44787 service nova] Creating event network-changed:01f7d055-f780-49f6-98a2-68c108a3aa05 for instance 061921a1-1ddc-4500-aee0-4cbeb018807f on hv-cinder-83588 May 10 16:52:31.880194 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-4550f08f-524e-41e5-875d-2b7dd900e6c4 req-f3d31e32-a95a-4d0a-8fc1-ac25ecc44787 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028858 May 10 16:52:31.881170 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 292/559] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:32.510243 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b700bf6f-47bb-4c4c-aedc-963e6084358c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:32.512120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b700bf6f-47bb-4c4c-aedc-963e6084358c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:32.518734 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b700bf6f-47bb-4c4c-aedc-963e6084358c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:32.519040 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b700bf6f-47bb-4c4c-aedc-963e6084358c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:32.519829 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b700bf6f-47bb-4c4c-aedc-963e6084358c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:32.520266 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b700bf6f-47bb-4c4c-aedc-963e6084358c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:32.552614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b700bf6f-47bb-4c4c-aedc-963e6084358c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046313 May 10 16:52:32.553208 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 268/560] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 10 16:52:32 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:52:32.862813 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1cfea8b5-8f73-4701-b1d9-03e6ca924a27 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:32.863374 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1cfea8b5-8f73-4701-b1d9-03e6ca924a27 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:32.869600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1cfea8b5-8f73-4701-b1d9-03e6ca924a27 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:32.870059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1cfea8b5-8f73-4701-b1d9-03e6ca924a27 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:32.870843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1cfea8b5-8f73-4701-b1d9-03e6ca924a27 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:32.871288 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1cfea8b5-8f73-4701-b1d9-03e6ca924a27 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:33.035191 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1cfea8b5-8f73-4701-b1d9-03e6ca924a27 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:33.042986 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1cfea8b5-8f73-4701-b1d9-03e6ca924a27 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1752 microversion: 2.1 time: 0.185802 May 10 16:52:33.043570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 293/561] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:32 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:33.564284 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a4b73b9e-a631-43c7-9fc0-a08e75c68c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:33.565209 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a4b73b9e-a631-43c7-9fc0-a08e75c68c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:33.571499 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a4b73b9e-a631-43c7-9fc0-a08e75c68c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:33.571955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a4b73b9e-a631-43c7-9fc0-a08e75c68c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:33.572823 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a4b73b9e-a631-43c7-9fc0-a08e75c68c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:33.573177 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a4b73b9e-a631-43c7-9fc0-a08e75c68c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:33.603600 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a4b73b9e-a631-43c7-9fc0-a08e75c68c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043312 May 10 16:52:33.604161 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 269/562] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 10 16:52:33 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:52:34.061129 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b3766135-099e-40e5-8782-5f4175bfd26d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:34.061774 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b3766135-099e-40e5-8782-5f4175bfd26d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:34.068895 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3766135-099e-40e5-8782-5f4175bfd26d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:34.069349 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3766135-099e-40e5-8782-5f4175bfd26d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:34.070120 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3766135-099e-40e5-8782-5f4175bfd26d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:34.070558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3766135-099e-40e5-8782-5f4175bfd26d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:34.211551 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b3766135-099e-40e5-8782-5f4175bfd26d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:34.219699 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b3766135-099e-40e5-8782-5f4175bfd26d tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.162165 May 10 16:52:34.220298 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 294/563] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:34 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:34.615586 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4c46c8fc-bf80-4989-bf7f-be48294fa94d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:34.616528 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4c46c8fc-bf80-4989-bf7f-be48294fa94d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:34.622762 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c46c8fc-bf80-4989-bf7f-be48294fa94d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:34.623229 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c46c8fc-bf80-4989-bf7f-be48294fa94d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:34.623987 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c46c8fc-bf80-4989-bf7f-be48294fa94d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:34.624450 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c46c8fc-bf80-4989-bf7f-be48294fa94d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:34.653560 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4c46c8fc-bf80-4989-bf7f-be48294fa94d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041823 May 10 16:52:34.654126 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 270/564] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 10 16:52:34 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:52:35.237196 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ea6f9ec7-8747-42f3-b9c5-0882045cc7e8 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:35.237745 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ea6f9ec7-8747-42f3-b9c5-0882045cc7e8 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:35.244060 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ea6f9ec7-8747-42f3-b9c5-0882045cc7e8 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:35.244540 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ea6f9ec7-8747-42f3-b9c5-0882045cc7e8 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:35.245306 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ea6f9ec7-8747-42f3-b9c5-0882045cc7e8 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:35.245740 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ea6f9ec7-8747-42f3-b9c5-0882045cc7e8 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:35.385772 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ea6f9ec7-8747-42f3-b9c5-0882045cc7e8 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:35.394102 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ea6f9ec7-8747-42f3-b9c5-0882045cc7e8 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.161024 May 10 16:52:35.394679 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 295/565] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:35 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:35.668009 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e5f9118c-65e6-4a43-a1d3-74c49abd2805 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:35.668973 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e5f9118c-65e6-4a43-a1d3-74c49abd2805 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:35.676391 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5f9118c-65e6-4a43-a1d3-74c49abd2805 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:35.676844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5f9118c-65e6-4a43-a1d3-74c49abd2805 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:35.677611 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5f9118c-65e6-4a43-a1d3-74c49abd2805 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:35.678080 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5f9118c-65e6-4a43-a1d3-74c49abd2805 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:35.710154 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e5f9118c-65e6-4a43-a1d3-74c49abd2805 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047380 May 10 16:52:35.710714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 271/566] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 10 16:52:35 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:52:36.411940 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f79ca5f8-cdd2-4fb2-8a0a-02e23c2a7206 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:36.412576 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f79ca5f8-cdd2-4fb2-8a0a-02e23c2a7206 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:36.418843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f79ca5f8-cdd2-4fb2-8a0a-02e23c2a7206 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:36.419287 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f79ca5f8-cdd2-4fb2-8a0a-02e23c2a7206 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:36.420039 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f79ca5f8-cdd2-4fb2-8a0a-02e23c2a7206 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:36.420500 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f79ca5f8-cdd2-4fb2-8a0a-02e23c2a7206 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:36.560423 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f79ca5f8-cdd2-4fb2-8a0a-02e23c2a7206 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:36.568551 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f79ca5f8-cdd2-4fb2-8a0a-02e23c2a7206 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.160394 May 10 16:52:36.569124 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 296/567] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:36 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:36.722352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f5adbc61-1a54-44f8-9710-fc685aa84a82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:36.723223 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f5adbc61-1a54-44f8-9710-fc685aa84a82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:36.729418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5adbc61-1a54-44f8-9710-fc685aa84a82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:36.729862 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5adbc61-1a54-44f8-9710-fc685aa84a82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:36.730617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5adbc61-1a54-44f8-9710-fc685aa84a82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:36.731043 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5adbc61-1a54-44f8-9710-fc685aa84a82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:36.760000 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f5adbc61-1a54-44f8-9710-fc685aa84a82 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042434 May 10 16:52:36.760584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 272/568] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 10 16:52:36 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:52:37.585796 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-91bd5148-1dbf-41f8-b170-94b95abcaa8b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:37.586402 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-91bd5148-1dbf-41f8-b170-94b95abcaa8b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:37.592660 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-91bd5148-1dbf-41f8-b170-94b95abcaa8b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:37.593108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-91bd5148-1dbf-41f8-b170-94b95abcaa8b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:37.593891 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-91bd5148-1dbf-41f8-b170-94b95abcaa8b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:37.594320 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-91bd5148-1dbf-41f8-b170-94b95abcaa8b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:37.738067 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-91bd5148-1dbf-41f8-b170-94b95abcaa8b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:37.745944 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-91bd5148-1dbf-41f8-b170-94b95abcaa8b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.164057 May 10 16:52:37.746520 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 297/569] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:37 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:37.771586 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-adaad5ec-2e48-4c98-9d80-ce8aaa186993 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:37.772706 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-adaad5ec-2e48-4c98-9d80-ce8aaa186993 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:37.778728 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-adaad5ec-2e48-4c98-9d80-ce8aaa186993 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:37.779178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-adaad5ec-2e48-4c98-9d80-ce8aaa186993 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:37.779939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-adaad5ec-2e48-4c98-9d80-ce8aaa186993 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:37.780406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-adaad5ec-2e48-4c98-9d80-ce8aaa186993 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:37.808979 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-adaad5ec-2e48-4c98-9d80-ce8aaa186993 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041320 May 10 16:52:37.809531 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 273/570] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 10 16:52:37 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:52:38.763589 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-656f833f-5f04-4b57-a376-9c73109810b3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:38.764214 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-656f833f-5f04-4b57-a376-9c73109810b3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:38.771894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-656f833f-5f04-4b57-a376-9c73109810b3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:38.772388 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-656f833f-5f04-4b57-a376-9c73109810b3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:38.773177 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-656f833f-5f04-4b57-a376-9c73109810b3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:38.773617 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-656f833f-5f04-4b57-a376-9c73109810b3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:38.821235 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b7c1092f-1bcf-44af-a4ef-4dfaf039457b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:38.822146 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b7c1092f-1bcf-44af-a4ef-4dfaf039457b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:38.828787 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b7c1092f-1bcf-44af-a4ef-4dfaf039457b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:38.829811 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b7c1092f-1bcf-44af-a4ef-4dfaf039457b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:38.830729 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b7c1092f-1bcf-44af-a4ef-4dfaf039457b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:38.831156 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b7c1092f-1bcf-44af-a4ef-4dfaf039457b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:38.862917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b7c1092f-1bcf-44af-a4ef-4dfaf039457b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045799 May 10 16:52:38.863512 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 274/571] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 10 16:52:38 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:38.934953 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-379002fc-5ce0-4212-adcc-821cb2c13e81 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:38.935450 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-379002fc-5ce0-4212-adcc-821cb2c13e81 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:38.942401 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-379002fc-5ce0-4212-adcc-821cb2c13e81 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:38.942859 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-379002fc-5ce0-4212-adcc-821cb2c13e81 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:38.943834 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-379002fc-5ce0-4212-adcc-821cb2c13e81 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:38.944324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-379002fc-5ce0-4212-adcc-821cb2c13e81 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:38.950289 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-656f833f-5f04-4b57-a376-9c73109810b3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:38.961723 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-656f833f-5f04-4b57-a376-9c73109810b3 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.202514 May 10 16:52:38.964324 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 298/572] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:38 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:38.972592 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-379002fc-5ce0-4212-adcc-821cb2c13e81 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:52:39.058347 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-379002fc-5ce0-4212-adcc-821cb2c13e81 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 204 len: 0 microversion: 2.20 time: 0.126832 May 10 16:52:39.059257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 275/573] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 10 16:52:38 2022] DELETE /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 16:52:39.069392 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-669bf7e0-f8e9-431c-8e26-cbfa7ff19905 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:39.070013 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-669bf7e0-f8e9-431c-8e26-cbfa7ff19905 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:39.076806 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-669bf7e0-f8e9-431c-8e26-cbfa7ff19905 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:39.077268 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-669bf7e0-f8e9-431c-8e26-cbfa7ff19905 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:39.078486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-669bf7e0-f8e9-431c-8e26-cbfa7ff19905 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:39.078486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-669bf7e0-f8e9-431c-8e26-cbfa7ff19905 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:39.225363 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-669bf7e0-f8e9-431c-8e26-cbfa7ff19905 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:39.234007 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-669bf7e0-f8e9-431c-8e26-cbfa7ff19905 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:39.236086 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-669bf7e0-f8e9-431c-8e26-cbfa7ff19905 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:39.237276 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-669bf7e0-f8e9-431c-8e26-cbfa7ff19905 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.172067 May 10 16:52:39.237872 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 299/574] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:39 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:39.979741 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3510b409-1173-4151-a878-aa4ac5c6301a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:39.980494 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3510b409-1173-4151-a878-aa4ac5c6301a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:39.989897 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3510b409-1173-4151-a878-aa4ac5c6301a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:39.990347 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3510b409-1173-4151-a878-aa4ac5c6301a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:39.991110 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3510b409-1173-4151-a878-aa4ac5c6301a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:39.991540 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3510b409-1173-4151-a878-aa4ac5c6301a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:40.137536 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3510b409-1173-4151-a878-aa4ac5c6301a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:40.146492 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3510b409-1173-4151-a878-aa4ac5c6301a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.171018 May 10 16:52:40.147059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 276/575] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:39 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:40.259042 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9cbfe4c0-8fec-466a-813f-fcc0a2d4b242 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:40.259605 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9cbfe4c0-8fec-466a-813f-fcc0a2d4b242 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:40.266054 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9cbfe4c0-8fec-466a-813f-fcc0a2d4b242 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:40.267031 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9cbfe4c0-8fec-466a-813f-fcc0a2d4b242 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:40.267829 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9cbfe4c0-8fec-466a-813f-fcc0a2d4b242 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:40.268305 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9cbfe4c0-8fec-466a-813f-fcc0a2d4b242 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:40.395038 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9cbfe4c0-8fec-466a-813f-fcc0a2d4b242 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:40.403896 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9cbfe4c0-8fec-466a-813f-fcc0a2d4b242 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:40.405443 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9cbfe4c0-8fec-466a-813f-fcc0a2d4b242 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:40.406617 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9cbfe4c0-8fec-466a-813f-fcc0a2d4b242 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.151626 May 10 16:52:40.407198 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 300/576] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:40 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:41.164564 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-65bf8c29-215e-46a2-b13b-b23e463d1572 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:41.165224 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-65bf8c29-215e-46a2-b13b-b23e463d1572 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:41.171950 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-65bf8c29-215e-46a2-b13b-b23e463d1572 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:41.172475 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-65bf8c29-215e-46a2-b13b-b23e463d1572 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:41.173844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-65bf8c29-215e-46a2-b13b-b23e463d1572 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:41.174304 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-65bf8c29-215e-46a2-b13b-b23e463d1572 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:41.317923 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-65bf8c29-215e-46a2-b13b-b23e463d1572 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:41.325651 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-65bf8c29-215e-46a2-b13b-b23e463d1572 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.165278 May 10 16:52:41.326216 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 277/577] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:41 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:41.425972 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6d4d36d1-7193-4d1d-b09b-443d4d55f3be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:41.426507 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6d4d36d1-7193-4d1d-b09b-443d4d55f3be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:41.432872 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6d4d36d1-7193-4d1d-b09b-443d4d55f3be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:41.433328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6d4d36d1-7193-4d1d-b09b-443d4d55f3be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:41.434101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6d4d36d1-7193-4d1d-b09b-443d4d55f3be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:41.434540 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6d4d36d1-7193-4d1d-b09b-443d4d55f3be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:41.560948 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6d4d36d1-7193-4d1d-b09b-443d4d55f3be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:41.569018 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6d4d36d1-7193-4d1d-b09b-443d4d55f3be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:41.570546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6d4d36d1-7193-4d1d-b09b-443d4d55f3be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:41.571701 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6d4d36d1-7193-4d1d-b09b-443d4d55f3be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.150955 May 10 16:52:41.572291 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 301/578] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:41 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:42.343147 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ff915842-41dd-4b80-940d-8189f888eb5c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:42.343782 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ff915842-41dd-4b80-940d-8189f888eb5c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:42.350365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff915842-41dd-4b80-940d-8189f888eb5c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:42.350858 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff915842-41dd-4b80-940d-8189f888eb5c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:42.351793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff915842-41dd-4b80-940d-8189f888eb5c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:42.352231 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff915842-41dd-4b80-940d-8189f888eb5c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:42.493613 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ff915842-41dd-4b80-940d-8189f888eb5c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:42.502839 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ff915842-41dd-4b80-940d-8189f888eb5c tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.163529 May 10 16:52:42.503415 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 278/579] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:42 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:42.590579 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5d2539e2-c206-4b6e-a479-01b3a21f0dbd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:42.591184 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-5d2539e2-c206-4b6e-a479-01b3a21f0dbd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:42.598269 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5d2539e2-c206-4b6e-a479-01b3a21f0dbd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:42.598697 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5d2539e2-c206-4b6e-a479-01b3a21f0dbd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:42.599467 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5d2539e2-c206-4b6e-a479-01b3a21f0dbd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:42.599899 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5d2539e2-c206-4b6e-a479-01b3a21f0dbd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:42.799681 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5d2539e2-c206-4b6e-a479-01b3a21f0dbd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:42.808784 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5d2539e2-c206-4b6e-a479-01b3a21f0dbd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:42.810335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5d2539e2-c206-4b6e-a479-01b3a21f0dbd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:42.811491 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5d2539e2-c206-4b6e-a479-01b3a21f0dbd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1723 microversion: 2.20 time: 0.224798 May 10 16:52:42.812062 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 302/580] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:42 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:43.124660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-968b851c-5ca6-42d9-82d8-732ae19c598b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:43.125594 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-968b851c-5ca6-42d9-82d8-732ae19c598b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:43.132777 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-968b851c-5ca6-42d9-82d8-732ae19c598b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.133239 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-968b851c-5ca6-42d9-82d8-732ae19c598b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.134010 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-968b851c-5ca6-42d9-82d8-732ae19c598b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.134449 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-968b851c-5ca6-42d9-82d8-732ae19c598b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.165650 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-968b851c-5ca6-42d9-82d8-732ae19c598b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044819 May 10 16:52:43.166353 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 279/581] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:52:43 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:52:43.236538 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-240dac34-abac-41e2-813c-a535fdd39b15 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:43.236538 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-240dac34-abac-41e2-813c-a535fdd39b15 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:43.243026 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-240dac34-abac-41e2-813c-a535fdd39b15 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.243329 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-240dac34-abac-41e2-813c-a535fdd39b15 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.244023 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-240dac34-abac-41e2-813c-a535fdd39b15 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.244487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-240dac34-abac-41e2-813c-a535fdd39b15 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.273142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-240dac34-abac-41e2-813c-a535fdd39b15 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Going to try to terminate instance {{(pid=134195) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:52:43.368622 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-240dac34-abac-41e2-813c-a535fdd39b15 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 204 len: 0 microversion: 2.1 time: 0.136684 May 10 16:52:43.369580 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 303/582] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:52:43 2022] DELETE /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:52:43.379102 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-591b466a-80fd-4175-9174-a1fdbe00c4f0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:43.379737 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-591b466a-80fd-4175-9174-a1fdbe00c4f0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:43.386382 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-591b466a-80fd-4175-9174-a1fdbe00c4f0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.386838 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-591b466a-80fd-4175-9174-a1fdbe00c4f0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.387620 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-591b466a-80fd-4175-9174-a1fdbe00c4f0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.388067 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-591b466a-80fd-4175-9174-a1fdbe00c4f0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.522100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1534ac59-e002-44c2-abb4-1ac14e4c5dfc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:43.523703 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1534ac59-e002-44c2-abb4-1ac14e4c5dfc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:43.529947 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1534ac59-e002-44c2-abb4-1ac14e4c5dfc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.530718 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1534ac59-e002-44c2-abb4-1ac14e4c5dfc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.531738 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1534ac59-e002-44c2-abb4-1ac14e4c5dfc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.533627 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1534ac59-e002-44c2-abb4-1ac14e4c5dfc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.566317 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-591b466a-80fd-4175-9174-a1fdbe00c4f0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:43.582714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-591b466a-80fd-4175-9174-a1fdbe00c4f0 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1673 microversion: 2.1 time: 0.208722 May 10 16:52:43.583876 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 280/583] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:43 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:43.588869 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-d9925207-6066-48bd-bb02-5cc111801553 req-08fc0f98-b647-418f-8af2-18105bd58a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6739110-4e68-4993-83ec-7c1503f7b87b", "name": "network-vif-deleted", "tag": "494f67f0-21ef-40e7-8bd0-9ab88f71dbef"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:43.598321 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-d9925207-6066-48bd-bb02-5cc111801553 req-08fc0f98-b647-418f-8af2-18105bd58a2f service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.599248 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-d9925207-6066-48bd-bb02-5cc111801553 req-08fc0f98-b647-418f-8af2-18105bd58a2f service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.618190 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-d9925207-6066-48bd-bb02-5cc111801553 req-08fc0f98-b647-418f-8af2-18105bd58a2f service nova] Creating event network-vif-deleted:494f67f0-21ef-40e7-8bd0-9ab88f71dbef for instance c6739110-4e68-4993-83ec-7c1503f7b87b on hv-cinder-83588 May 10 16:52:43.623835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-d9925207-6066-48bd-bb02-5cc111801553 req-08fc0f98-b647-418f-8af2-18105bd58a2f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038464 May 10 16:52:43.624671 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 281/584] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:43.719098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1534ac59-e002-44c2-abb4-1ac14e4c5dfc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:43.729904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1534ac59-e002-44c2-abb4-1ac14e4c5dfc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.213638 May 10 16:52:43.730616 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 304/585] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:43 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:52:43.830073 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-64d14945-f299-4d6f-9beb-3e495c8c8d94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:43.831220 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-64d14945-f299-4d6f-9beb-3e495c8c8d94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:43.837358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-64d14945-f299-4d6f-9beb-3e495c8c8d94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.837882 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-64d14945-f299-4d6f-9beb-3e495c8c8d94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.838717 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-64d14945-f299-4d6f-9beb-3e495c8c8d94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:43.839214 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-64d14945-f299-4d6f-9beb-3e495c8c8d94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:43.905094 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-64d14945-f299-4d6f-9beb-3e495c8c8d94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:43.914056 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-64d14945-f299-4d6f-9beb-3e495c8c8d94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:43.915895 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-64d14945-f299-4d6f-9beb-3e495c8c8d94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:43.917165 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-64d14945-f299-4d6f-9beb-3e495c8c8d94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1655 microversion: 2.20 time: 0.091474 May 10 16:52:43.917801 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 282/586] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:43 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:44.600722 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-16382a23-ff2a-400d-bcc9-3aecf496fbe1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:44.601553 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-16382a23-ff2a-400d-bcc9-3aecf496fbe1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:44.608202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-16382a23-ff2a-400d-bcc9-3aecf496fbe1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:44.608782 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-16382a23-ff2a-400d-bcc9-3aecf496fbe1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:44.609803 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-16382a23-ff2a-400d-bcc9-3aecf496fbe1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:44.611329 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-16382a23-ff2a-400d-bcc9-3aecf496fbe1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:44.752411 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d5abc8fb-61fd-41eb-b799-1e6b77b9a871 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:44.754215 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d5abc8fb-61fd-41eb-b799-1e6b77b9a871 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:44.756456 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-16382a23-ff2a-400d-bcc9-3aecf496fbe1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:44.763560 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d5abc8fb-61fd-41eb-b799-1e6b77b9a871 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:44.763794 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-16382a23-ff2a-400d-bcc9-3aecf496fbe1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1673 microversion: 2.1 time: 0.166934 May 10 16:52:44.764569 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d5abc8fb-61fd-41eb-b799-1e6b77b9a871 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:44.764906 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 305/587] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:44 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:44.766081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d5abc8fb-61fd-41eb-b799-1e6b77b9a871 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:44.767554 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d5abc8fb-61fd-41eb-b799-1e6b77b9a871 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:44.927067 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d5abc8fb-61fd-41eb-b799-1e6b77b9a871 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:44.936451 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2a392c10-2588-479b-94cf-9282008daa91 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:44.937084 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d5abc8fb-61fd-41eb-b799-1e6b77b9a871 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.192174 May 10 16:52:44.937708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 283/588] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:44 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:44.939474 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2a392c10-2588-479b-94cf-9282008daa91 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:44.949761 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2a392c10-2588-479b-94cf-9282008daa91 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:44.950290 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2a392c10-2588-479b-94cf-9282008daa91 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:44.951184 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2a392c10-2588-479b-94cf-9282008daa91 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:44.951721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2a392c10-2588-479b-94cf-9282008daa91 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:45.012660 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2a392c10-2588-479b-94cf-9282008daa91 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:45.021335 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2a392c10-2588-479b-94cf-9282008daa91 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:45.022856 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2a392c10-2588-479b-94cf-9282008daa91 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:45.024012 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2a392c10-2588-479b-94cf-9282008daa91 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1655 microversion: 2.20 time: 0.091876 May 10 16:52:45.024793 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 306/589] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:44 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:45.783369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-eb6171c6-28d0-45e6-9dca-eebc1f662599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:45.783940 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-eb6171c6-28d0-45e6-9dca-eebc1f662599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:45.790919 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb6171c6-28d0-45e6-9dca-eebc1f662599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:45.791364 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb6171c6-28d0-45e6-9dca-eebc1f662599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:45.792152 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb6171c6-28d0-45e6-9dca-eebc1f662599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:45.792642 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb6171c6-28d0-45e6-9dca-eebc1f662599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:45.939698 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-eb6171c6-28d0-45e6-9dca-eebc1f662599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:45.947872 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-eb6171c6-28d0-45e6-9dca-eebc1f662599 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1673 microversion: 2.1 time: 0.169148 May 10 16:52:45.949846 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 284/590] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:45 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:45.956139 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-fc2efb8c-85cc-4e9b-b1ae-3459fa424c97 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:45.957046 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-fc2efb8c-85cc-4e9b-b1ae-3459fa424c97 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:45.964488 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc2efb8c-85cc-4e9b-b1ae-3459fa424c97 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:45.964976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc2efb8c-85cc-4e9b-b1ae-3459fa424c97 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:45.965787 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc2efb8c-85cc-4e9b-b1ae-3459fa424c97 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:45.966226 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc2efb8c-85cc-4e9b-b1ae-3459fa424c97 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:46.042098 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:46.042911 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:46.050343 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:46.051096 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:46.052071 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:46.052699 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:46.097211 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:46.107082 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:46.107884 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lazy-loading 'fault' on Instance uuid c6739110-4e68-4993-83ec-7c1503f7b87b {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:52:46.161326 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:46.170879 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:46.173764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:46.175760 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9371b0a3-577d-49e9-9bfa-0038a9e1d5be tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 200 len: 1371 microversion: 2.20 time: 0.137454 May 10 16:52:46.176879 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 285/591] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:46 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 1371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:46.222562 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-fc2efb8c-85cc-4e9b-b1ae-3459fa424c97 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:46.230966 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-fc2efb8c-85cc-4e9b-b1ae-3459fa424c97 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.279785 May 10 16:52:46.231545 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 307/592] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:45 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:52:46.562081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-10fc47cd-9585-4100-977e-4ed53a476258 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:46.562607 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-10fc47cd-9585-4100-977e-4ed53a476258 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:46.568804 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-10fc47cd-9585-4100-977e-4ed53a476258 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:46.569262 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-10fc47cd-9585-4100-977e-4ed53a476258 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:46.570131 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-10fc47cd-9585-4100-977e-4ed53a476258 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:46.570593 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-10fc47cd-9585-4100-977e-4ed53a476258 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:46.660243 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-10fc47cd-9585-4100-977e-4ed53a476258 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lazy-loading 'services' on Instance uuid b5c8deb8-8525-4818-a322-888512260d7a {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:52:46.745253 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-10fc47cd-9585-4100-977e-4ed53a476258 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a/os-volume_attachments/e6d4267e-3b0c-4ef1-9ec0-e7f6046ec53f" status: 202 len: 0 microversion: 2.1 time: 0.186872 May 10 16:52:46.745843 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 286/593] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:52:46 2022] DELETE /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a/os-volume_attachments/e6d4267e-3b0c-4ef1-9ec0-e7f6046ec53f => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:52:46.966107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2f1a671d-3dc4-4543-b3fe-7b69ecdc7a6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:46.966737 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2f1a671d-3dc4-4543-b3fe-7b69ecdc7a6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:46.974379 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2f1a671d-3dc4-4543-b3fe-7b69ecdc7a6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:46.974845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2f1a671d-3dc4-4543-b3fe-7b69ecdc7a6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:46.975629 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2f1a671d-3dc4-4543-b3fe-7b69ecdc7a6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:46.976070 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2f1a671d-3dc4-4543-b3fe-7b69ecdc7a6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:47.074405 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2f1a671d-3dc4-4543-b3fe-7b69ecdc7a6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:47.089511 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-20241e90-2757-4271-874c-5078c230e515 req-b214f241-1c42-46ec-aedd-7d387be86e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b9076f-b216-4383-b9fd-80b05ada72a8", "name": "network-vif-deleted", "tag": "0ead7ac5-4337-4cb0-99ac-13f8b389ddd0"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:47.098681 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2f1a671d-3dc4-4543-b3fe-7b69ecdc7a6c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 200 len: 1606 microversion: 2.1 time: 0.136366 May 10 16:52:47.099294 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 308/594] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:46 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 1606 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:47.103636 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-20241e90-2757-4271-874c-5078c230e515 req-b214f241-1c42-46ec-aedd-7d387be86e32 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:47.104082 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-20241e90-2757-4271-874c-5078c230e515 req-b214f241-1c42-46ec-aedd-7d387be86e32 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:47.117040 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-20241e90-2757-4271-874c-5078c230e515 req-b214f241-1c42-46ec-aedd-7d387be86e32 service nova] Creating event network-vif-deleted:0ead7ac5-4337-4cb0-99ac-13f8b389ddd0 for instance a2b9076f-b216-4383-b9fd-80b05ada72a8 on hv-cinder-83588 May 10 16:52:47.122654 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-20241e90-2757-4271-874c-5078c230e515 req-b214f241-1c42-46ec-aedd-7d387be86e32 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037627 May 10 16:52:47.123259 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 287/595] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:52:47.196548 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6e76f35c-3a3f-44dc-aef4-d37d9830c6db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:47.197333 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6e76f35c-3a3f-44dc-aef4-d37d9830c6db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:47.204962 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6e76f35c-3a3f-44dc-aef4-d37d9830c6db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:47.205809 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6e76f35c-3a3f-44dc-aef4-d37d9830c6db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:47.206659 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6e76f35c-3a3f-44dc-aef4-d37d9830c6db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:47.207200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6e76f35c-3a3f-44dc-aef4-d37d9830c6db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:47.238235 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-6e76f35c-3a3f-44dc-aef4-d37d9830c6db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] HTTP exception thrown: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6e76f35c-3a3f-44dc-aef4-d37d9830c6db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Request method failure captured: May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b HTTP/1.1 May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdNjmY01frvymW2xtFv8Bebf9L_QLGU7XWg_XL1EZ9eUJgtDsx1Qw4Ton1kx7cJXTZlHfAlqf64bN2bkPTVXsq0x8OUyNMV7nO3QMXfNjkT1UJ6okcd8xi184YFpVR68wILRIgF-f8PwCTQHXzMRc_y4_K-z8DNbLeoVCDO0dr2koc May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:52:47.241155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 25229d5ef3be47988accfdee5f9209b8 May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:52:47.242978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'c6739110-4e68-4993-83ec-7c1503f7b87b'} May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:52:47.243883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:52:47.245370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:52:47.248435 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6e76f35c-3a3f-44dc-aef4-d37d9830c6db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Returning 404 to user: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:52:47.249489 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6e76f35c-3a3f-44dc-aef4-d37d9830c6db tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 404 len: 111 microversion: 2.20 time: 0.057550 May 10 16:52:47.250564 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 309/596] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:47 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 16:52:47.257132 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-05ef8228-3532-4414-93d7-7fc661018b2e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:47.258219 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-05ef8228-3532-4414-93d7-7fc661018b2e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:47.262088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ab06e27b-0cec-4c0b-b258-53c5c6accaf5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '.version_select at 0x7f5fb63ee5e0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:47.265852 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-05ef8228-3532-4414-93d7-7fc661018b2e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:47.267842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-05ef8228-3532-4414-93d7-7fc661018b2e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:47.268949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-05ef8228-3532-4414-93d7-7fc661018b2e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:47.270277 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-05ef8228-3532-4414-93d7-7fc661018b2e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:47.300245 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ab06e27b-0cec-4c0b-b258-53c5c6accaf5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-897707862" status: 204 len: 0 microversion: 2.20 time: 0.044376 May 10 16:52:47.303573 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 310/597] 10.222.0.48 () {60 vars in 1258 bytes} [Tue May 10 16:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-897707862 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 16:52:47.480544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-05ef8228-3532-4414-93d7-7fc661018b2e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:47.490146 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-05ef8228-3532-4414-93d7-7fc661018b2e tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.242457 May 10 16:52:47.500360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 288/598] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:47 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:47.906210 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e809da68-31c0-4342-b5fa-b0b02a19e368 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:47.906747 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e809da68-31c0-4342-b5fa-b0b02a19e368 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:47.915096 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e809da68-31c0-4342-b5fa-b0b02a19e368 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:47.915551 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e809da68-31c0-4342-b5fa-b0b02a19e368 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:47.916610 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e809da68-31c0-4342-b5fa-b0b02a19e368 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:47.917262 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e809da68-31c0-4342-b5fa-b0b02a19e368 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:47.946992 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e809da68-31c0-4342-b5fa-b0b02a19e368 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Going to try to terminate instance {{(pid=134195) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:52:48.036160 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e809da68-31c0-4342-b5fa-b0b02a19e368 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 204 len: 0 microversion: 2.1 time: 0.133339 May 10 16:52:48.037406 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 311/599] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:52:47 2022] DELETE /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 16:52:48.045909 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-dd157218-4c6c-44f7-a903-e6cf5b6656b5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:48.046536 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-dd157218-4c6c-44f7-a903-e6cf5b6656b5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:48.055520 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dd157218-4c6c-44f7-a903-e6cf5b6656b5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:48.056189 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dd157218-4c6c-44f7-a903-e6cf5b6656b5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:48.057019 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dd157218-4c6c-44f7-a903-e6cf5b6656b5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:48.057460 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-dd157218-4c6c-44f7-a903-e6cf5b6656b5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:48.103107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f6cd3666-0e3a-405f-9d94-1606e8ed8338 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Action: 'create', calling method: .version_select at 0x7f5fb63bb4c0>, body: {"keypair": {"name": "tempest-keypair-197847241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+quf6g+EVzQ/VjoqRCAT3PnFQjqLI81VNEGl09c7KIPaCSzMRYZwklNDMgvpOg87fD+/19X2mkvD+i7ro8iMVKrqiL9cJvP41eI4paPz49gCYDqagST8zuo1POjeQE8w=="}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:48.119252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-f6cd3666-0e3a-405f-9d94-1606e8ed8338 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Getting quotas for project a26f2126d1804c3caf0f83a1eb47fbff. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:52:48.123480 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-f6cd3666-0e3a-405f-9d94-1606e8ed8338 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Getting quotas for user 25229d5ef3be47988accfdee5f9209b8 and project a26f2126d1804c3caf0f83a1eb47fbff. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:52:48.151624 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f6cd3666-0e3a-405f-9d94-1606e8ed8338 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052337 May 10 16:52:48.151926 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 312/600] 10.222.0.48 () {62 vars in 1199 bytes} [Tue May 10 16:52:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 10 16:52:48.156690 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e033e48f-90ac-48c4-97a9-00225cc09c6f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:48.158029 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e033e48f-90ac-48c4-97a9-00225cc09c6f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:48.164241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e033e48f-90ac-48c4-97a9-00225cc09c6f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:48.164739 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e033e48f-90ac-48c4-97a9-00225cc09c6f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:48.165527 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e033e48f-90ac-48c4-97a9-00225cc09c6f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:48.166152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e033e48f-90ac-48c4-97a9-00225cc09c6f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:48.183142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-e033e48f-90ac-48c4-97a9-00225cc09c6f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] HTTP exception thrown: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e033e48f-90ac-48c4-97a9-00225cc09c6f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Request method failure captured: May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 HTTP/1.1 May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdQUWME-M42T6ap2wvSA72LK3d_8fYYKg-JbDtSEnqXrr9wRvjRj-AERPVrC38IdC0ML7XTjQp2fDBjckEn3WZudtx7Mt-kskWqVr8rRVM5UDB3x4FYg_H-qxfut0TYZ82aAmVtldXdH0PSUolsqoATMo9yZ-4jrKtkkoxp5oiWD1c May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:52:48.185130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeTestJSON-1128424456 May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: e2a00f1a578d44abadaa39db5235363a May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:52:48.186767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'a2b9076f-b216-4383-b9fd-80b05ada72a8'} May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:52:48.187708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:52:48.191074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:52:48.193617 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e033e48f-90ac-48c4-97a9-00225cc09c6f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Returning 404 to user: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:52:48.193617 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e033e48f-90ac-48c4-97a9-00225cc09c6f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 404 len: 111 microversion: 2.1 time: 0.033643 May 10 16:52:48.193617 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 313/601] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:48 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:52:48.196156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-622295b9-55c6-42ed-8de2-b29df45a330a tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '.version_select at 0x7f5fb6380700>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:48.216164 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-622295b9-55c6-42ed-8de2-b29df45a330a tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065765841" status: 202 len: 0 microversion: 2.1 time: 0.023600 May 10 16:52:48.217116 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 314/602] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 10 16:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065765841 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 16:52:48.270013 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-dd157218-4c6c-44f7-a903-e6cf5b6656b5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:48.278217 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-dd157218-4c6c-44f7-a903-e6cf5b6656b5 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1513 microversion: 2.1 time: 0.236295 May 10 16:52:48.288480 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 289/603] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:48 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:48.518002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7479ccac-bb62-4cc1-bc19-32461bdd9689 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:48.518864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7479ccac-bb62-4cc1-bc19-32461bdd9689 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:48.533541 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7479ccac-bb62-4cc1-bc19-32461bdd9689 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:48.537516 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7479ccac-bb62-4cc1-bc19-32461bdd9689 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:48.538483 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7479ccac-bb62-4cc1-bc19-32461bdd9689 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:48.539012 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7479ccac-bb62-4cc1-bc19-32461bdd9689 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:48.761775 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7479ccac-bb62-4cc1-bc19-32461bdd9689 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:48.775534 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7479ccac-bb62-4cc1-bc19-32461bdd9689 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.262672 May 10 16:52:48.780755 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 315/604] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:48 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:48.981442 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-291d82dd-6590-4d7c-b6eb-c79471abfe74 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'create', calling method: .version_select at 0x7f5fb6d0fdc0>, body: {"keypair": {"name": "tempest-keypair-637518848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuqsFHjJQYJQp+Hx9avvfaF2XLRgHdiq6aH3PxHkej1TAiXmVChvXpcwnKz9+OMoZdqeYOY0vd3y/dFH8O1A1lE1qXWpp+dMQR2yjMDxfn+CUxeIhi99IBIyoIMppal7A=="}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:48.997758 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-291d82dd-6590-4d7c-b6eb-c79471abfe74 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Getting quotas for project 6c526b65f8454d7e84b29236f42417f7. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:52:49.002471 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-291d82dd-6590-4d7c-b6eb-c79471abfe74 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Getting quotas for user e2a00f1a578d44abadaa39db5235363a and project 6c526b65f8454d7e84b29236f42417f7. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:52:49.025505 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-291d82dd-6590-4d7c-b6eb-c79471abfe74 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047859 May 10 16:52:49.026120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 290/605] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 10 16:52:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:49.300223 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d8fb4799-c8e1-49d4-9527-95be56e4ae4c tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:49.301297 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d8fb4799-c8e1-49d4-9527-95be56e4ae4c tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:49.311790 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d8fb4799-c8e1-49d4-9527-95be56e4ae4c tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:49.312333 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d8fb4799-c8e1-49d4-9527-95be56e4ae4c tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:49.314129 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d8fb4799-c8e1-49d4-9527-95be56e4ae4c tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:49.315057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d8fb4799-c8e1-49d4-9527-95be56e4ae4c tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:49.648900 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d8fb4799-c8e1-49d4-9527-95be56e4ae4c tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:49.658069 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d8fb4799-c8e1-49d4-9527-95be56e4ae4c tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1513 microversion: 2.1 time: 0.364519 May 10 16:52:49.659149 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 316/606] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:49 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1513 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:49.796153 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-17ae67a0-115e-4b66-bdbf-91607b299e34 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:49.796944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-17ae67a0-115e-4b66-bdbf-91607b299e34 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:49.817454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-17ae67a0-115e-4b66-bdbf-91607b299e34 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:49.818006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-17ae67a0-115e-4b66-bdbf-91607b299e34 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:49.819232 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-17ae67a0-115e-4b66-bdbf-91607b299e34 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:49.820773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-17ae67a0-115e-4b66-bdbf-91607b299e34 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:49.975474 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1326216204", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90344bc1-cc22-4179-9584-f0a07adf617d"}], "security_groups": [{"name": "tempest-securitygroup--1863441005"}], "key_name": "tempest-keypair-197847241", "user_data": "}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:50.098120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-17ae67a0-115e-4b66-bdbf-91607b299e34 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:50.113300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-17ae67a0-115e-4b66-bdbf-91607b299e34 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.323494 May 10 16:52:50.114210 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 291/607] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:49 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:50.151580 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.network.neutron [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] validate_networks() for [('90344bc1-cc22-4179-9584-f0a07adf617d', None, None, None, None, None)] {{(pid=134195) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:52:50.551488 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1188529456", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a644c79f-3db2-4028-a56c-6b5bff2a3f86"}], "security_groups": [{"name": "tempest-securitygroup--1019191864"}], "key_name": "tempest-keypair-637518848", "user_data": "}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:50.669226 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] validate_networks() for [('a644c79f-3db2-4028-a56c-6b5bff2a3f86', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:52:50.922444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Flavor limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:52:50.923202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Image limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:52:50.923558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Flavor pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:52:50.924151 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Image pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:52:50.925020 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:52:50.936639 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:50.937156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:50.938720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:50.939439 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:50.959406 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Getting quotas for project a26f2126d1804c3caf0f83a1eb47fbff. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:52:50.964098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Getting quotas for user 25229d5ef3be47988accfdee5f9209b8 and project a26f2126d1804c3caf0f83a1eb47fbff. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:52:50.977515 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Going to run 1 instances... {{(pid=134195) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:52:50.979808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134195) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:52:51.029185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f02d159e-dd2c-43b9-b7b6-7796f3a30e08 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.058340 May 10 16:52:51.030043 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 317/608] 10.222.0.48 () {62 vars in 1187 bytes} [Tue May 10 16:52:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 16:52:51.040232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:51.040668 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:51.047293 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:51.047293 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:51.048774 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:51.049227 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:51.090800 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:51.091182 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:51.091649 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lazy-loading 'fault' on Instance uuid b5c8deb8-8525-4818-a322-888512260d7a {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:52:51.100389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:52:51.101438 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:52:51.102124 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:52:51.102742 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:52:51.103372 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:52:51.115891 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:51.116387 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:51.117251 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:51.117690 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:51.139759 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Getting quotas for project 6c526b65f8454d7e84b29236f42417f7. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:52:51.150018 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Getting quotas for user e2a00f1a578d44abadaa39db5235363a and project 6c526b65f8454d7e84b29236f42417f7. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:52:51.155029 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd61c2b29a8e448e9d18ac20959f3e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:51.166249 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:52:51.168993 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:52:51.175283 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-22ec6064-03f3-48cc-abef-4d7ce9f20481 tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 200 len: 1309 microversion: 2.1 time: 0.144093 May 10 16:52:51.176546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 318/609] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:51 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 1309 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:51.192831 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-24f09b3b-d35a-47c0-8384-a6d6cf1fa086 req-648172ce-1f01-4292-aa63-889601d3af83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c8deb8-8525-4818-a322-888512260d7a", "name": "network-vif-deleted", "tag": "9b019ea1-4c69-432b-9c7a-818601fff78a"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:51.206772 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-24f09b3b-d35a-47c0-8384-a6d6cf1fa086 req-648172ce-1f01-4292-aa63-889601d3af83 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:51.207716 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-24f09b3b-d35a-47c0-8384-a6d6cf1fa086 req-648172ce-1f01-4292-aa63-889601d3af83 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:51.224187 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-24f09b3b-d35a-47c0-8384-a6d6cf1fa086 req-648172ce-1f01-4292-aa63-889601d3af83 service nova] Creating event network-vif-deleted:9b019ea1-4c69-432b-9c7a-818601fff78a for instance b5c8deb8-8525-4818-a322-888512260d7a on hv-cinder-83588 May 10 16:52:51.230358 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-24f09b3b-d35a-47c0-8384-a6d6cf1fa086 req-648172ce-1f01-4292-aa63-889601d3af83 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051450 May 10 16:52:51.231470 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 319/610] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:51.237898 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-939126df-6be1-46dd-a754-6f67c9f7cdc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:51.238129 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ffc50d6d-f518-4c19-becb-b61bc6a5cee8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691983 May 10 16:52:51.238988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-939126df-6be1-46dd-a754-6f67c9f7cdc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:51.244005 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 292/611] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:52:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:52:51.244974 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-43cc058c-7ac3-4eab-853e-26d18832e3ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:51.245702 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-43cc058c-7ac3-4eab-853e-26d18832e3ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:51.254768 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-43cc058c-7ac3-4eab-853e-26d18832e3ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:51.255200 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-43cc058c-7ac3-4eab-853e-26d18832e3ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:51.256093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-43cc058c-7ac3-4eab-853e-26d18832e3ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:51.256570 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-43cc058c-7ac3-4eab-853e-26d18832e3ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:51.338978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-939126df-6be1-46dd-a754-6f67c9f7cdc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:51.348776 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-939126df-6be1-46dd-a754-6f67c9f7cdc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:51.351141 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-939126df-6be1-46dd-a754-6f67c9f7cdc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:51.352298 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-939126df-6be1-46dd-a754-6f67c9f7cdc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1281 microversion: 2.20 time: 0.119235 May 10 16:52:51.352926 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 320/612] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:51 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:51.386412 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f409996a-0135-4fa0-8b5d-feb56fac6dfe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:51.387036 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f409996a-0135-4fa0-8b5d-feb56fac6dfe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:51.450201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-43cc058c-7ac3-4eab-853e-26d18832e3ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:51.459791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-43cc058c-7ac3-4eab-853e-26d18832e3ef tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.219299 May 10 16:52:51.460828 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 293/613] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:51 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:51.464664 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f409996a-0135-4fa0-8b5d-feb56fac6dfe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:51.471805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f409996a-0135-4fa0-8b5d-feb56fac6dfe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1237 microversion: 2.1 time: 0.092198 May 10 16:52:51.481583 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 321/614] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:51 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1237 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:52.195311 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-49affd11-e711-4248-a729-f3bce8887fde tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:52.195924 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-49affd11-e711-4248-a729-f3bce8887fde tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] [instance: b5c8deb8-8525-4818-a322-888512260d7a] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:52.202464 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-49affd11-e711-4248-a729-f3bce8887fde tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:52.202921 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-49affd11-e711-4248-a729-f3bce8887fde tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:52.204289 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-49affd11-e711-4248-a729-f3bce8887fde tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:52.204789 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-49affd11-e711-4248-a729-f3bce8887fde tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:52.221525 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-49affd11-e711-4248-a729-f3bce8887fde tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] HTTP exception thrown: Instance b5c8deb8-8525-4818-a322-888512260d7a could not be found. May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-49affd11-e711-4248-a729-f3bce8887fde tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Request method failure captured: May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a HTTP/1.1 May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepfPYlx1afomJHwrgVrfyn98mdKO4IaaUNX3oBiExz2ISfRJ0SmZ675D9GKm0iLsxN7-4PApL0GqilaYDIg6MOpKtcN_Gl9VFpiAL9r79yT-YHst3GBxWOQZzrc-tXd1BKF3UuPA1-nWYPMoW8Wq22nrWWMvjoq9kEJa1pBgeiZup9o May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: ea67afdf22fd4b41ac5f34bc29f3b7b8 May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1691006374 May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:52:52.223201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea67afdf22fd4b41ac5f34bc29f3b7b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea67afdf22fd4b41ac5f34bc29f3b7b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea67afdf22fd4b41ac5f34bc29f3b7b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea67afdf22fd4b41ac5f34bc29f3b7b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-VolumesSnapshotTestJSON-1691006374 May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: ea67afdf22fd4b41ac5f34bc29f3b7b8 May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1691006374 May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-VolumesSnapshotTestJSON-1691006374-project May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: dd61c2b29a8e448e9d18ac20959f3e1d May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-VolumesSnapshotTestJSON-1691006374-project May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance b5c8deb8-8525-4818-a322-888512260d7a could not be found. May 10 16:52:52.224949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': 'b5c8deb8-8525-4818-a322-888512260d7a'} May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c8deb8-8525-4818-a322-888512260d7a could not be found. May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:52:52.225835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c8deb8-8525-4818-a322-888512260d7a could not be found. May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c8deb8-8525-4818-a322-888512260d7a could not be found. May 10 16:52:52.227358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:52:52.228620 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-49affd11-e711-4248-a729-f3bce8887fde tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] Returning 404 to user: Instance b5c8deb8-8525-4818-a322-888512260d7a could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:52:52.228620 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-49affd11-e711-4248-a729-f3bce8887fde tempest-VolumesSnapshotTestJSON-1691006374 tempest-VolumesSnapshotTestJSON-1691006374-project] 10.222.0.48 "GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a" status: 404 len: 111 microversion: 2.1 time: 0.033246 May 10 16:52:52.228620 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 294/615] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:52 2022] GET /compute/v2.1/servers/b5c8deb8-8525-4818-a322-888512260d7a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 16:52:52.371367 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-cd0d3ef6-828a-40de-a7df-bf46b076dc0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:52.371980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-cd0d3ef6-828a-40de-a7df-bf46b076dc0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:52.379623 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cd0d3ef6-828a-40de-a7df-bf46b076dc0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:52.380387 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cd0d3ef6-828a-40de-a7df-bf46b076dc0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:52.381160 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cd0d3ef6-828a-40de-a7df-bf46b076dc0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:52.381595 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cd0d3ef6-828a-40de-a7df-bf46b076dc0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:52.461711 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cd0d3ef6-828a-40de-a7df-bf46b076dc0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:52.473410 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cd0d3ef6-828a-40de-a7df-bf46b076dc0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:52.476340 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cd0d3ef6-828a-40de-a7df-bf46b076dc0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:52.477784 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-cd0d3ef6-828a-40de-a7df-bf46b076dc0b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1341 microversion: 2.20 time: 0.110664 May 10 16:52:52.478863 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 322/616] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:52 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1341 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:52.480045 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a270f956-0974-4478-9fa4-cee5678b53ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:52.480789 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a270f956-0974-4478-9fa4-cee5678b53ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:52.494394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a270f956-0974-4478-9fa4-cee5678b53ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:52.496901 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a270f956-0974-4478-9fa4-cee5678b53ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:52.498811 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1d15c07a-c7c2-4857-9622-4966e1c8cd93 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:52.501204 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a270f956-0974-4478-9fa4-cee5678b53ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:52.501518 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1d15c07a-c7c2-4857-9622-4966e1c8cd93 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:52.502703 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a270f956-0974-4478-9fa4-cee5678b53ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:52.511175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1d15c07a-c7c2-4857-9622-4966e1c8cd93 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:52.511645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1d15c07a-c7c2-4857-9622-4966e1c8cd93 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:52.512866 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1d15c07a-c7c2-4857-9622-4966e1c8cd93 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:52.513147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1d15c07a-c7c2-4857-9622-4966e1c8cd93 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:52.687729 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1d15c07a-c7c2-4857-9622-4966e1c8cd93 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:52.696206 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1d15c07a-c7c2-4857-9622-4966e1c8cd93 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1289 microversion: 2.1 time: 0.208116 May 10 16:52:52.708419 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a270f956-0974-4478-9fa4-cee5678b53ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:52.710523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 323/617] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:52 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1289 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:52.719784 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a270f956-0974-4478-9fa4-cee5678b53ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.243665 May 10 16:52:52.720743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 295/618] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:52 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:53.495861 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f7627a52-b285-4967-884a-321e872ba7e0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:53.496515 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f7627a52-b285-4967-884a-321e872ba7e0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:53.503108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f7627a52-b285-4967-884a-321e872ba7e0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:53.503563 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f7627a52-b285-4967-884a-321e872ba7e0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:53.504374 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f7627a52-b285-4967-884a-321e872ba7e0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:53.504823 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f7627a52-b285-4967-884a-321e872ba7e0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:53.620221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f7627a52-b285-4967-884a-321e872ba7e0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:53.629481 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f7627a52-b285-4967-884a-321e872ba7e0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:53.631045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f7627a52-b285-4967-884a-321e872ba7e0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:53.632382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f7627a52-b285-4967-884a-321e872ba7e0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1339 microversion: 2.20 time: 0.140362 May 10 16:52:53.632951 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 324/619] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:53 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1339 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:53.721687 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b7b1282f-8f7d-44ac-94fc-47a1bc43a44d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:53.722529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b7b1282f-8f7d-44ac-94fc-47a1bc43a44d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:53.729411 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b7b1282f-8f7d-44ac-94fc-47a1bc43a44d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:53.730028 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b7b1282f-8f7d-44ac-94fc-47a1bc43a44d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:53.731037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b7b1282f-8f7d-44ac-94fc-47a1bc43a44d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:53.731562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b7b1282f-8f7d-44ac-94fc-47a1bc43a44d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:53.741681 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b05a1d6b-670d-40d6-9ce1-3c742c9c4d94 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:53.743163 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b05a1d6b-670d-40d6-9ce1-3c742c9c4d94 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:53.761370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b05a1d6b-670d-40d6-9ce1-3c742c9c4d94 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:53.761841 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b05a1d6b-670d-40d6-9ce1-3c742c9c4d94 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:53.764969 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b05a1d6b-670d-40d6-9ce1-3c742c9c4d94 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:53.765584 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b05a1d6b-670d-40d6-9ce1-3c742c9c4d94 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:53.906470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b7b1282f-8f7d-44ac-94fc-47a1bc43a44d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:53.915039 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b7b1282f-8f7d-44ac-94fc-47a1bc43a44d tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.201088 May 10 16:52:53.928493 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 296/620] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:53 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:54.135392 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b05a1d6b-670d-40d6-9ce1-3c742c9c4d94 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:54.145391 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b05a1d6b-670d-40d6-9ce1-3c742c9c4d94 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.411736 May 10 16:52:54.145985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 325/621] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:53 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:52:54.651797 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-30c5a395-4401-4eab-9be5-1dd573379b9d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:54.652440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-30c5a395-4401-4eab-9be5-1dd573379b9d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:54.659456 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30c5a395-4401-4eab-9be5-1dd573379b9d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:54.659909 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30c5a395-4401-4eab-9be5-1dd573379b9d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:54.660727 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30c5a395-4401-4eab-9be5-1dd573379b9d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:54.661171 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30c5a395-4401-4eab-9be5-1dd573379b9d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:54.795381 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-30c5a395-4401-4eab-9be5-1dd573379b9d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:54.804596 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-30c5a395-4401-4eab-9be5-1dd573379b9d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:54.806339 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-30c5a395-4401-4eab-9be5-1dd573379b9d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:54.807627 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-30c5a395-4401-4eab-9be5-1dd573379b9d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.159847 May 10 16:52:54.808329 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 297/622] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:54 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:54.933246 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-76fe9ac9-3625-4066-b737-3bca753dbdb1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:54.933846 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-76fe9ac9-3625-4066-b737-3bca753dbdb1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:54.941356 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-76fe9ac9-3625-4066-b737-3bca753dbdb1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:54.941814 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-76fe9ac9-3625-4066-b737-3bca753dbdb1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:54.942584 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-76fe9ac9-3625-4066-b737-3bca753dbdb1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:54.943027 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-76fe9ac9-3625-4066-b737-3bca753dbdb1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:55.073096 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-76fe9ac9-3625-4066-b737-3bca753dbdb1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:55.080493 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-76fe9ac9-3625-4066-b737-3bca753dbdb1 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.151069 May 10 16:52:55.081069 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 326/623] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:54 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:55.162342 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-15e55ee3-bc51-415e-b972-5e716daec5b6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:55.162948 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-15e55ee3-bc51-415e-b972-5e716daec5b6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:55.169053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-15e55ee3-bc51-415e-b972-5e716daec5b6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:55.169508 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-15e55ee3-bc51-415e-b972-5e716daec5b6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:55.170284 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-15e55ee3-bc51-415e-b972-5e716daec5b6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:55.170726 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-15e55ee3-bc51-415e-b972-5e716daec5b6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:55.311562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-15e55ee3-bc51-415e-b972-5e716daec5b6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:55.320104 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-15e55ee3-bc51-415e-b972-5e716daec5b6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.161638 May 10 16:52:55.320712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 298/624] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:55 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:55.828947 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7a5e51ae-6d7a-4dca-9bcb-9ea3d30303f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:55.829803 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7a5e51ae-6d7a-4dca-9bcb-9ea3d30303f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:55.839660 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a5e51ae-6d7a-4dca-9bcb-9ea3d30303f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:55.840433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a5e51ae-6d7a-4dca-9bcb-9ea3d30303f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:55.841372 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a5e51ae-6d7a-4dca-9bcb-9ea3d30303f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:55.841826 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a5e51ae-6d7a-4dca-9bcb-9ea3d30303f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:55.984727 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7a5e51ae-6d7a-4dca-9bcb-9ea3d30303f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:55.992957 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7a5e51ae-6d7a-4dca-9bcb-9ea3d30303f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:55.994491 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7a5e51ae-6d7a-4dca-9bcb-9ea3d30303f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:55.995597 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7a5e51ae-6d7a-4dca-9bcb-9ea3d30303f8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.171285 May 10 16:52:55.996189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 327/625] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:55 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:56.097484 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-31875932-c9ac-43ce-b4b1-cec01028ce06 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:56.098163 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-31875932-c9ac-43ce-b4b1-cec01028ce06 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:56.104409 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-31875932-c9ac-43ce-b4b1-cec01028ce06 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:56.104857 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-31875932-c9ac-43ce-b4b1-cec01028ce06 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:56.105625 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-31875932-c9ac-43ce-b4b1-cec01028ce06 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:56.106061 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-31875932-c9ac-43ce-b4b1-cec01028ce06 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:56.236358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-31875932-c9ac-43ce-b4b1-cec01028ce06 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:56.244733 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-31875932-c9ac-43ce-b4b1-cec01028ce06 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.151828 May 10 16:52:56.245298 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 299/626] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:56 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:56.337405 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0aba05d0-2739-4ad7-bf15-8380f2b8d554 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:56.338140 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0aba05d0-2739-4ad7-bf15-8380f2b8d554 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:56.344508 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0aba05d0-2739-4ad7-bf15-8380f2b8d554 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:56.344969 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0aba05d0-2739-4ad7-bf15-8380f2b8d554 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:56.345751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0aba05d0-2739-4ad7-bf15-8380f2b8d554 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:56.346196 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0aba05d0-2739-4ad7-bf15-8380f2b8d554 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:56.507701 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-0aba05d0-2739-4ad7-bf15-8380f2b8d554 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:56.517101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0aba05d0-2739-4ad7-bf15-8380f2b8d554 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1757 microversion: 2.1 time: 0.183579 May 10 16:52:56.517744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 328/627] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:56 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:57.013853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2d6b3a75-2aa0-4a41-a185-6425c8dc8aa8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:57.014820 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2d6b3a75-2aa0-4a41-a185-6425c8dc8aa8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:57.021654 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d6b3a75-2aa0-4a41-a185-6425c8dc8aa8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:57.022102 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d6b3a75-2aa0-4a41-a185-6425c8dc8aa8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:57.022905 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d6b3a75-2aa0-4a41-a185-6425c8dc8aa8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:57.023332 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d6b3a75-2aa0-4a41-a185-6425c8dc8aa8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:57.161537 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2d6b3a75-2aa0-4a41-a185-6425c8dc8aa8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:57.169314 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2d6b3a75-2aa0-4a41-a185-6425c8dc8aa8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:57.170932 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2d6b3a75-2aa0-4a41-a185-6425c8dc8aa8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:57.172720 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2d6b3a75-2aa0-4a41-a185-6425c8dc8aa8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.162220 May 10 16:52:57.173402 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 300/628] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:57 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:57.263703 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-998bd743-ae6b-4790-8b09-c127126cd33e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:57.264360 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-998bd743-ae6b-4790-8b09-c127126cd33e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:57.272122 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-998bd743-ae6b-4790-8b09-c127126cd33e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:57.272726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-998bd743-ae6b-4790-8b09-c127126cd33e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:57.274120 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-998bd743-ae6b-4790-8b09-c127126cd33e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:57.274569 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-998bd743-ae6b-4790-8b09-c127126cd33e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:57.534456 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-76920453-5170-43ae-ac81-9dbe9d22d110 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:57.536581 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-76920453-5170-43ae-ac81-9dbe9d22d110 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:57.544625 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-76920453-5170-43ae-ac81-9dbe9d22d110 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:57.545615 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-76920453-5170-43ae-ac81-9dbe9d22d110 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:57.546734 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-76920453-5170-43ae-ac81-9dbe9d22d110 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:57.548792 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-76920453-5170-43ae-ac81-9dbe9d22d110 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:57.681689 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-998bd743-ae6b-4790-8b09-c127126cd33e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:57.694303 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-998bd743-ae6b-4790-8b09-c127126cd33e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.435851 May 10 16:52:57.695338 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 329/629] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:57 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:57.736631 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-76920453-5170-43ae-ac81-9dbe9d22d110 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:57.744955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-76920453-5170-43ae-ac81-9dbe9d22d110 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1760 microversion: 2.1 time: 0.214497 May 10 16:52:57.745530 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 301/630] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:57 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1760 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:52:57.894673 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-c49834b2-1136-48c5-8539-d529d4124994 req-bcc1f30e-4a5d-441e-b776-f98760d30e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c65f78-2474-4331-ad66-738a8ac2162c", "tag": "b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:57.919669 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-c49834b2-1136-48c5-8539-d529d4124994 req-bcc1f30e-4a5d-441e-b776-f98760d30e7a service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:57.922496 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-c49834b2-1136-48c5-8539-d529d4124994 req-bcc1f30e-4a5d-441e-b776-f98760d30e7a service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:57.941489 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-c49834b2-1136-48c5-8539-d529d4124994 req-bcc1f30e-4a5d-441e-b776-f98760d30e7a service nova] Creating event network-changed:b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b for instance a8c65f78-2474-4331-ad66-738a8ac2162c on hv-cinder-83588 May 10 16:52:57.947438 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-c49834b2-1136-48c5-8539-d529d4124994 req-bcc1f30e-4a5d-441e-b776-f98760d30e7a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066567 May 10 16:52:57.948635 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 330/631] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:58.193146 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9d56bc82-c191-4cfe-913e-37762c5517e3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:58.193825 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9d56bc82-c191-4cfe-913e-37762c5517e3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:58.200291 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9d56bc82-c191-4cfe-913e-37762c5517e3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:58.200825 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9d56bc82-c191-4cfe-913e-37762c5517e3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:58.201657 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9d56bc82-c191-4cfe-913e-37762c5517e3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:58.202186 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9d56bc82-c191-4cfe-913e-37762c5517e3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:58.356189 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9d56bc82-c191-4cfe-913e-37762c5517e3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:58.367070 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9d56bc82-c191-4cfe-913e-37762c5517e3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:58.368923 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9d56bc82-c191-4cfe-913e-37762c5517e3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:58.370343 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9d56bc82-c191-4cfe-913e-37762c5517e3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.183186 May 10 16:52:58.371496 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 302/632] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:58 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:58.714624 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a952ba3c-1469-4032-af8a-5d0e6fbcc488 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:58.716589 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a952ba3c-1469-4032-af8a-5d0e6fbcc488 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:58.727965 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a952ba3c-1469-4032-af8a-5d0e6fbcc488 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:58.729222 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a952ba3c-1469-4032-af8a-5d0e6fbcc488 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:58.730025 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a952ba3c-1469-4032-af8a-5d0e6fbcc488 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:58.730602 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a952ba3c-1469-4032-af8a-5d0e6fbcc488 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:59.022821 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a952ba3c-1469-4032-af8a-5d0e6fbcc488 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:59.030709 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a952ba3c-1469-4032-af8a-5d0e6fbcc488 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.321949 May 10 16:52:59.031292 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 331/633] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:52:58 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:59.388927 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-da9aae18-b47a-426a-8031-62d18e8d674c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:59.389532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-da9aae18-b47a-426a-8031-62d18e8d674c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:59.396567 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-da9aae18-b47a-426a-8031-62d18e8d674c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:59.397025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-da9aae18-b47a-426a-8031-62d18e8d674c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:59.397831 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-da9aae18-b47a-426a-8031-62d18e8d674c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:59.398273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-da9aae18-b47a-426a-8031-62d18e8d674c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:59.533015 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-da9aae18-b47a-426a-8031-62d18e8d674c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:59.546012 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-da9aae18-b47a-426a-8031-62d18e8d674c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:59.549584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-da9aae18-b47a-426a-8031-62d18e8d674c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:59.551721 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-da9aae18-b47a-426a-8031-62d18e8d674c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.166463 May 10 16:52:59.552692 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 303/634] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:52:59 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:52:59.993943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-0a1583f8-9321-401c-9fc9-bb73fb94b831 req-7031bb01-c01d-4e48-b3ca-0fc33032d73a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a006de3-8903-42e7-bd9c-922e5c314761", "tag": "fbedc143-bd9d-4787-99d5-b8ca349557d4"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:00.003219 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-0a1583f8-9321-401c-9fc9-bb73fb94b831 req-7031bb01-c01d-4e48-b3ca-0fc33032d73a service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:00.003644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-0a1583f8-9321-401c-9fc9-bb73fb94b831 req-7031bb01-c01d-4e48-b3ca-0fc33032d73a service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:00.014309 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-0a1583f8-9321-401c-9fc9-bb73fb94b831 req-7031bb01-c01d-4e48-b3ca-0fc33032d73a service nova] Creating event network-changed:fbedc143-bd9d-4787-99d5-b8ca349557d4 for instance 5a006de3-8903-42e7-bd9c-922e5c314761 on hv-cinder-83588 May 10 16:53:00.019652 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-0a1583f8-9321-401c-9fc9-bb73fb94b831 req-7031bb01-c01d-4e48-b3ca-0fc33032d73a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029358 May 10 16:53:00.020226 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 332/635] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:00.049216 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c5dca073-4443-4f92-97ad-d1166b27e6d8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:00.050120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c5dca073-4443-4f92-97ad-d1166b27e6d8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:00.056424 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c5dca073-4443-4f92-97ad-d1166b27e6d8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:00.056882 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c5dca073-4443-4f92-97ad-d1166b27e6d8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:00.057665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c5dca073-4443-4f92-97ad-d1166b27e6d8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:00.058106 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c5dca073-4443-4f92-97ad-d1166b27e6d8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:00.199548 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c5dca073-4443-4f92-97ad-d1166b27e6d8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:00.208680 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c5dca073-4443-4f92-97ad-d1166b27e6d8 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.163761 May 10 16:53:00.209260 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 304/636] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:00 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:00.571006 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-22d9d5e8-072c-4a53-915f-d0a7e3a647ca tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:00.571818 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-22d9d5e8-072c-4a53-915f-d0a7e3a647ca tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:00.578270 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-22d9d5e8-072c-4a53-915f-d0a7e3a647ca tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:00.579249 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-22d9d5e8-072c-4a53-915f-d0a7e3a647ca tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:00.580119 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-22d9d5e8-072c-4a53-915f-d0a7e3a647ca tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:00.580119 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-22d9d5e8-072c-4a53-915f-d0a7e3a647ca tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:00.724663 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-22d9d5e8-072c-4a53-915f-d0a7e3a647ca tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:00.733561 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-22d9d5e8-072c-4a53-915f-d0a7e3a647ca tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:00.737062 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-22d9d5e8-072c-4a53-915f-d0a7e3a647ca tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:00.738637 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-22d9d5e8-072c-4a53-915f-d0a7e3a647ca tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.171836 May 10 16:53:00.739389 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 333/637] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:00 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:53:01.230102 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-85529416-5f76-4054-81bb-6460b418dee2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:01.231309 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-85529416-5f76-4054-81bb-6460b418dee2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:01.240423 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-85529416-5f76-4054-81bb-6460b418dee2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:01.241154 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-85529416-5f76-4054-81bb-6460b418dee2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:01.242338 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-85529416-5f76-4054-81bb-6460b418dee2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:01.242964 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-85529416-5f76-4054-81bb-6460b418dee2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:01.374223 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-85529416-5f76-4054-81bb-6460b418dee2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:01.382616 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-85529416-5f76-4054-81bb-6460b418dee2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.157294 May 10 16:53:01.383181 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 305/638] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:01 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:01.764070 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4b1f9cde-3b30-4138-9bb3-16ac9338fbd6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:01.764749 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4b1f9cde-3b30-4138-9bb3-16ac9338fbd6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:01.771395 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4b1f9cde-3b30-4138-9bb3-16ac9338fbd6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:01.771870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4b1f9cde-3b30-4138-9bb3-16ac9338fbd6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:01.772673 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4b1f9cde-3b30-4138-9bb3-16ac9338fbd6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:01.773111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4b1f9cde-3b30-4138-9bb3-16ac9338fbd6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:01.925413 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4b1f9cde-3b30-4138-9bb3-16ac9338fbd6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:01.933167 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4b1f9cde-3b30-4138-9bb3-16ac9338fbd6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:01.934691 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4b1f9cde-3b30-4138-9bb3-16ac9338fbd6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:01.935826 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4b1f9cde-3b30-4138-9bb3-16ac9338fbd6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.175671 May 10 16:53:01.936412 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 334/639] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:01 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:53:02.402774 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e5a6eb5a-9dea-44c2-8c55-8eff52f5001e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:02.403559 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e5a6eb5a-9dea-44c2-8c55-8eff52f5001e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:02.410342 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5a6eb5a-9dea-44c2-8c55-8eff52f5001e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:02.410812 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5a6eb5a-9dea-44c2-8c55-8eff52f5001e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:02.411579 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5a6eb5a-9dea-44c2-8c55-8eff52f5001e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:02.412153 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e5a6eb5a-9dea-44c2-8c55-8eff52f5001e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:02.596085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e5a6eb5a-9dea-44c2-8c55-8eff52f5001e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:02.603476 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e5a6eb5a-9dea-44c2-8c55-8eff52f5001e tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.207062 May 10 16:53:02.604044 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 306/640] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:02 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:02.954680 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1422e50a-2e70-44dc-a74b-7b3422346249 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:02.955288 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1422e50a-2e70-44dc-a74b-7b3422346249 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:02.961785 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1422e50a-2e70-44dc-a74b-7b3422346249 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:02.962256 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1422e50a-2e70-44dc-a74b-7b3422346249 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:02.963032 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1422e50a-2e70-44dc-a74b-7b3422346249 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:02.963477 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1422e50a-2e70-44dc-a74b-7b3422346249 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:03.122187 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1422e50a-2e70-44dc-a74b-7b3422346249 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:03.132644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1422e50a-2e70-44dc-a74b-7b3422346249 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:03.134418 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1422e50a-2e70-44dc-a74b-7b3422346249 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:03.135612 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1422e50a-2e70-44dc-a74b-7b3422346249 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.185226 May 10 16:53:03.136159 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 335/641] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:02 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:53:03.621240 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3f92bc78-0927-49dd-8cdd-5fc5230205b2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:03.621871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3f92bc78-0927-49dd-8cdd-5fc5230205b2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:03.628844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3f92bc78-0927-49dd-8cdd-5fc5230205b2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:03.629293 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3f92bc78-0927-49dd-8cdd-5fc5230205b2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:03.630056 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3f92bc78-0927-49dd-8cdd-5fc5230205b2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:03.630489 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3f92bc78-0927-49dd-8cdd-5fc5230205b2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:03.761166 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-3f92bc78-0927-49dd-8cdd-5fc5230205b2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:03.769122 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3f92bc78-0927-49dd-8cdd-5fc5230205b2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.151854 May 10 16:53:03.769682 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 307/642] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:03 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:53:04.153958 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-70140567-be88-468d-96c3-bb6695ec8dc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:04.154570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-70140567-be88-468d-96c3-bb6695ec8dc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:04.162098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-70140567-be88-468d-96c3-bb6695ec8dc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:04.162549 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-70140567-be88-468d-96c3-bb6695ec8dc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:04.163333 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-70140567-be88-468d-96c3-bb6695ec8dc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:04.163854 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-70140567-be88-468d-96c3-bb6695ec8dc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:04.431264 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-70140567-be88-468d-96c3-bb6695ec8dc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:04.440742 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-70140567-be88-468d-96c3-bb6695ec8dc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:04.442436 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-70140567-be88-468d-96c3-bb6695ec8dc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:04.443840 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-70140567-be88-468d-96c3-bb6695ec8dc3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.293710 May 10 16:53:04.444824 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 336/643] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:04 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:53:04.788203 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8d4a6c9c-16dd-4ee8-938c-f3826a88badd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:04.788803 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8d4a6c9c-16dd-4ee8-938c-f3826a88badd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:04.795072 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8d4a6c9c-16dd-4ee8-938c-f3826a88badd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:04.795516 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8d4a6c9c-16dd-4ee8-938c-f3826a88badd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:04.796297 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8d4a6c9c-16dd-4ee8-938c-f3826a88badd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:04.797239 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8d4a6c9c-16dd-4ee8-938c-f3826a88badd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:04.923847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8d4a6c9c-16dd-4ee8-938c-f3826a88badd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:04.931660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8d4a6c9c-16dd-4ee8-938c-f3826a88badd tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.147376 May 10 16:53:04.932222 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 308/644] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:04 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:05.463496 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-414bc519-783e-4b8d-93fd-508c7c854bb1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:05.464189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-414bc519-783e-4b8d-93fd-508c7c854bb1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:05.471753 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-414bc519-783e-4b8d-93fd-508c7c854bb1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:05.472617 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-414bc519-783e-4b8d-93fd-508c7c854bb1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:05.473411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-414bc519-783e-4b8d-93fd-508c7c854bb1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:05.473860 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-414bc519-783e-4b8d-93fd-508c7c854bb1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:05.741348 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-414bc519-783e-4b8d-93fd-508c7c854bb1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:05.750857 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-414bc519-783e-4b8d-93fd-508c7c854bb1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:05.752944 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-414bc519-783e-4b8d-93fd-508c7c854bb1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:05.754510 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-414bc519-783e-4b8d-93fd-508c7c854bb1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.295319 May 10 16:53:05.761425 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 337/645] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:05 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:53:05.950848 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9df6b83d-8836-46dc-b78e-a052929e0f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:05.951520 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9df6b83d-8836-46dc-b78e-a052929e0f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:05.960188 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9df6b83d-8836-46dc-b78e-a052929e0f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:05.960870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9df6b83d-8836-46dc-b78e-a052929e0f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:05.961738 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9df6b83d-8836-46dc-b78e-a052929e0f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:05.962293 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9df6b83d-8836-46dc-b78e-a052929e0f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:06.073624 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-3690845f-2e84-4c63-a452-72520d302798 req-659518b4-3c20-402d-94b6-038f9a4c4f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a006de3-8903-42e7-bd9c-922e5c314761", "name": "network-vif-plugged", "status": "completed", "tag": "fbedc143-bd9d-4787-99d5-b8ca349557d4"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:06.082156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-3690845f-2e84-4c63-a452-72520d302798 req-659518b4-3c20-402d-94b6-038f9a4c4f53 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:06.082882 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-3690845f-2e84-4c63-a452-72520d302798 req-659518b4-3c20-402d-94b6-038f9a4c4f53 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:06.095586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-3690845f-2e84-4c63-a452-72520d302798 req-659518b4-3c20-402d-94b6-038f9a4c4f53 service nova] Creating event network-vif-plugged:fbedc143-bd9d-4787-99d5-b8ca349557d4 for instance 5a006de3-8903-42e7-bd9c-922e5c314761 on hv-cinder-83588 May 10 16:53:06.102413 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-3690845f-2e84-4c63-a452-72520d302798 req-659518b4-3c20-402d-94b6-038f9a4c4f53 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 May 10 16:53:06.103265 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 338/646] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:53:06.117816 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9df6b83d-8836-46dc-b78e-a052929e0f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:06.145263 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9df6b83d-8836-46dc-b78e-a052929e0f08 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.198504 May 10 16:53:06.147375 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 309/647] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:05 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:06.773781 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-08fb370e-f469-452d-ab64-e86c254cd4c0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:06.774488 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-08fb370e-f469-452d-ab64-e86c254cd4c0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:06.780748 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-08fb370e-f469-452d-ab64-e86c254cd4c0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:06.781795 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-08fb370e-f469-452d-ab64-e86c254cd4c0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:06.782804 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-08fb370e-f469-452d-ab64-e86c254cd4c0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:06.783236 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-08fb370e-f469-452d-ab64-e86c254cd4c0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:06.921032 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-08fb370e-f469-452d-ab64-e86c254cd4c0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:06.929739 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-08fb370e-f469-452d-ab64-e86c254cd4c0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:06.931248 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-08fb370e-f469-452d-ab64-e86c254cd4c0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:06.932375 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-08fb370e-f469-452d-ab64-e86c254cd4c0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.163363 May 10 16:53:06.932943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 339/648] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:06 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:53:07.163899 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-aef846ad-1515-49e9-9f1e-b6ca5e3f342f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:07.164471 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-aef846ad-1515-49e9-9f1e-b6ca5e3f342f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:07.170771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aef846ad-1515-49e9-9f1e-b6ca5e3f342f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:07.171223 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aef846ad-1515-49e9-9f1e-b6ca5e3f342f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:07.172619 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aef846ad-1515-49e9-9f1e-b6ca5e3f342f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:07.173070 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aef846ad-1515-49e9-9f1e-b6ca5e3f342f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:07.302923 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-aef846ad-1515-49e9-9f1e-b6ca5e3f342f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:07.310815 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-aef846ad-1515-49e9-9f1e-b6ca5e3f342f tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1363 microversion: 2.1 time: 0.150845 May 10 16:53:07.311396 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 310/649] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:07 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:07.951721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d2723f04-449d-4746-a420-b02b195802fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:07.952474 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d2723f04-449d-4746-a420-b02b195802fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:07.959683 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d2723f04-449d-4746-a420-b02b195802fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:07.960138 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d2723f04-449d-4746-a420-b02b195802fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:07.961158 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d2723f04-449d-4746-a420-b02b195802fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:07.961752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d2723f04-449d-4746-a420-b02b195802fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:08.097009 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d2723f04-449d-4746-a420-b02b195802fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:08.105482 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d2723f04-449d-4746-a420-b02b195802fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:08.106981 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d2723f04-449d-4746-a420-b02b195802fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:08.108090 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d2723f04-449d-4746-a420-b02b195802fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.162249 May 10 16:53:08.108738 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 340/650] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:07 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:53:08.150762 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-3315a1c6-153a-47ef-9847-baea694ac463 req-ee7a5b14-c90f-4f0a-b638-69b8dac80bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c65f78-2474-4331-ad66-738a8ac2162c", "name": "network-vif-plugged", "status": "completed", "tag": "b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:08.159522 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-3315a1c6-153a-47ef-9847-baea694ac463 req-ee7a5b14-c90f-4f0a-b638-69b8dac80bea service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:08.159949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-3315a1c6-153a-47ef-9847-baea694ac463 req-ee7a5b14-c90f-4f0a-b638-69b8dac80bea service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:08.171079 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-3315a1c6-153a-47ef-9847-baea694ac463 req-ee7a5b14-c90f-4f0a-b638-69b8dac80bea service nova] Creating event network-vif-plugged:b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b for instance a8c65f78-2474-4331-ad66-738a8ac2162c on hv-cinder-83588 May 10 16:53:08.176980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-3315a1c6-153a-47ef-9847-baea694ac463 req-ee7a5b14-c90f-4f0a-b638-69b8dac80bea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029857 May 10 16:53:08.177606 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 311/651] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:08.326949 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-fca9b235-1c57-473d-aed6-01fd39ca2464 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:08.327510 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-fca9b235-1c57-473d-aed6-01fd39ca2464 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:08.333579 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fca9b235-1c57-473d-aed6-01fd39ca2464 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:08.334034 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fca9b235-1c57-473d-aed6-01fd39ca2464 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:08.334816 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fca9b235-1c57-473d-aed6-01fd39ca2464 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:08.335252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fca9b235-1c57-473d-aed6-01fd39ca2464 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:08.491909 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-fca9b235-1c57-473d-aed6-01fd39ca2464 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:08.499353 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-fca9b235-1c57-473d-aed6-01fd39ca2464 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1550 microversion: 2.1 time: 0.176286 May 10 16:53:08.499951 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 341/652] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:08 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1550 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:08.517940 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4c1a7a93-7f6c-410e-880f-ae247034110a tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:08.518525 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4c1a7a93-7f6c-410e-880f-ae247034110a tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:08.524739 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c1a7a93-7f6c-410e-880f-ae247034110a tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:08.525198 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c1a7a93-7f6c-410e-880f-ae247034110a tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:08.525978 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c1a7a93-7f6c-410e-880f-ae247034110a tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:08.526411 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4c1a7a93-7f6c-410e-880f-ae247034110a tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:08.607081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4c1a7a93-7f6c-410e-880f-ae247034110a tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094098 May 10 16:53:08.608290 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 312/653] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 10 16:53:08 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:53:09.128085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f694b1bf-a9cf-47cd-b5c1-bbd686f42866 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:09.129595 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f694b1bf-a9cf-47cd-b5c1-bbd686f42866 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:09.135815 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f694b1bf-a9cf-47cd-b5c1-bbd686f42866 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:09.136266 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f694b1bf-a9cf-47cd-b5c1-bbd686f42866 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:09.137084 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f694b1bf-a9cf-47cd-b5c1-bbd686f42866 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:09.137539 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f694b1bf-a9cf-47cd-b5c1-bbd686f42866 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:09.285019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f694b1bf-a9cf-47cd-b5c1-bbd686f42866 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:09.294459 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f694b1bf-a9cf-47cd-b5c1-bbd686f42866 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:09.296217 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f694b1bf-a9cf-47cd-b5c1-bbd686f42866 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:09.298707 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f694b1bf-a9cf-47cd-b5c1-bbd686f42866 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1407 microversion: 2.20 time: 0.175241 May 10 16:53:09.299546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 342/654] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:09 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:53:09.885159 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-ef710d39-f079-4c03-b964-1445278f1f54 req-f8d05412-2188-4f52-a25f-3f626b928f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a006de3-8903-42e7-bd9c-922e5c314761", "tag": "fbedc143-bd9d-4787-99d5-b8ca349557d4"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:09.893498 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-ef710d39-f079-4c03-b964-1445278f1f54 req-f8d05412-2188-4f52-a25f-3f626b928f20 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:09.894028 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-ef710d39-f079-4c03-b964-1445278f1f54 req-f8d05412-2188-4f52-a25f-3f626b928f20 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:09.905121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-ef710d39-f079-4c03-b964-1445278f1f54 req-f8d05412-2188-4f52-a25f-3f626b928f20 service nova] Creating event network-changed:fbedc143-bd9d-4787-99d5-b8ca349557d4 for instance 5a006de3-8903-42e7-bd9c-922e5c314761 on hv-cinder-83588 May 10 16:53:09.910836 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-ef710d39-f079-4c03-b964-1445278f1f54 req-f8d05412-2188-4f52-a25f-3f626b928f20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029712 May 10 16:53:09.911519 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 313/655] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:10.318745 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e2805141-60bf-4f21-8fed-0b17ca5b3955 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:10.320150 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e2805141-60bf-4f21-8fed-0b17ca5b3955 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:10.328330 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e2805141-60bf-4f21-8fed-0b17ca5b3955 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:10.330110 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e2805141-60bf-4f21-8fed-0b17ca5b3955 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:10.331104 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e2805141-60bf-4f21-8fed-0b17ca5b3955 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:10.331679 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e2805141-60bf-4f21-8fed-0b17ca5b3955 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:10.539517 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e2805141-60bf-4f21-8fed-0b17ca5b3955 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:10.555806 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e2805141-60bf-4f21-8fed-0b17ca5b3955 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:10.558350 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e2805141-60bf-4f21-8fed-0b17ca5b3955 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:10.559674 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e2805141-60bf-4f21-8fed-0b17ca5b3955 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1598 microversion: 2.20 time: 0.245737 May 10 16:53:10.573066 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 343/656] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:10 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1598 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:53:10.583937 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e4b81698-bd0b-4f5f-bb88-bf90a187db22 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:10.584789 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e4b81698-bd0b-4f5f-bb88-bf90a187db22 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:10.592826 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4b81698-bd0b-4f5f-bb88-bf90a187db22 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:10.593267 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4b81698-bd0b-4f5f-bb88-bf90a187db22 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:10.595027 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4b81698-bd0b-4f5f-bb88-bf90a187db22 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:10.595638 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4b81698-bd0b-4f5f-bb88-bf90a187db22 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:10.688863 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e4b81698-bd0b-4f5f-bb88-bf90a187db22 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111154 May 10 16:53:10.690694 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 314/657] 10.222.0.48 () {60 vars in 1315 bytes} [Tue May 10 16:53:10 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:53:10.824185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f55c9347-c72c-4fb5-9bd2-73511331734c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:10.825057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f55c9347-c72c-4fb5-9bd2-73511331734c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:10.834563 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f55c9347-c72c-4fb5-9bd2-73511331734c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:10.836167 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f55c9347-c72c-4fb5-9bd2-73511331734c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:10.837489 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f55c9347-c72c-4fb5-9bd2-73511331734c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:10.838189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f55c9347-c72c-4fb5-9bd2-73511331734c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:10.951225 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-f55c9347-c72c-4fb5-9bd2-73511331734c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lazy-loading 'services' on Instance uuid 061921a1-1ddc-4500-aee0-4cbeb018807f {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:53:11.037781 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f55c9347-c72c-4fb5-9bd2-73511331734c tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "DELETE /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments/36421dfd-323a-4180-852b-3fd5f5052a5a" status: 202 len: 0 microversion: 2.1 time: 0.218045 May 10 16:53:11.038879 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 344/658] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:53:10 2022] DELETE /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments/36421dfd-323a-4180-852b-3fd5f5052a5a => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:53:11.048791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8dcee506-0ca9-4f1b-bcd1-da59f2efdcac tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:11.050638 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8dcee506-0ca9-4f1b-bcd1-da59f2efdcac tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:11.058221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8dcee506-0ca9-4f1b-bcd1-da59f2efdcac tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:11.059030 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8dcee506-0ca9-4f1b-bcd1-da59f2efdcac tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:11.060490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8dcee506-0ca9-4f1b-bcd1-da59f2efdcac tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:11.062071 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8dcee506-0ca9-4f1b-bcd1-da59f2efdcac tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:11.112232 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8dcee506-0ca9-4f1b-bcd1-da59f2efdcac tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068017 May 10 16:53:11.113189 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 315/659] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:53:11 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:11.931303 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-41c41040-326b-4eb1-9852-d276ed7bc4cb req-ce668313-c1ff-4459-8881-63771d2be4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c65f78-2474-4331-ad66-738a8ac2162c", "tag": "b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:11.942923 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-41c41040-326b-4eb1-9852-d276ed7bc4cb req-ce668313-c1ff-4459-8881-63771d2be4b6 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:11.943740 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-41c41040-326b-4eb1-9852-d276ed7bc4cb req-ce668313-c1ff-4459-8881-63771d2be4b6 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:11.956600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-41c41040-326b-4eb1-9852-d276ed7bc4cb req-ce668313-c1ff-4459-8881-63771d2be4b6 service nova] Creating event network-changed:b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b for instance a8c65f78-2474-4331-ad66-738a8ac2162c on hv-cinder-83588 May 10 16:53:11.961919 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-41c41040-326b-4eb1-9852-d276ed7bc4cb req-ce668313-c1ff-4459-8881-63771d2be4b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035171 May 10 16:53:11.962625 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 345/660] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:12.124773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-babe1ec4-8820-4b6d-ba1a-7329767fd378 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:12.127027 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-babe1ec4-8820-4b6d-ba1a-7329767fd378 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:12.133913 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-babe1ec4-8820-4b6d-ba1a-7329767fd378 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:12.134622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-babe1ec4-8820-4b6d-ba1a-7329767fd378 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:12.135141 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-babe1ec4-8820-4b6d-ba1a-7329767fd378 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:12.135841 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-babe1ec4-8820-4b6d-ba1a-7329767fd378 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:12.168360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-babe1ec4-8820-4b6d-ba1a-7329767fd378 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047571 May 10 16:53:12.173940 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 316/661] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:53:12 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:53:12.255602 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ae7ca648-a5f0-4000-8706-2e2d89b480b7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:12.256197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ae7ca648-a5f0-4000-8706-2e2d89b480b7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:12.276030 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ae7ca648-a5f0-4000-8706-2e2d89b480b7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:12.276524 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ae7ca648-a5f0-4000-8706-2e2d89b480b7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:12.277610 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ae7ca648-a5f0-4000-8706-2e2d89b480b7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:12.277908 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ae7ca648-a5f0-4000-8706-2e2d89b480b7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:12.314715 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ae7ca648-a5f0-4000-8706-2e2d89b480b7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Going to try to terminate instance {{(pid=134195) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:53:12.444454 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ae7ca648-a5f0-4000-8706-2e2d89b480b7 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "DELETE /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 204 len: 0 microversion: 2.1 time: 0.195066 May 10 16:53:12.445789 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 346/662] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:53:12 2022] DELETE /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:53:12.456013 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-55e88bb0-30b7-4959-9a89-fd4090f21f40 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:12.456801 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-55e88bb0-30b7-4959-9a89-fd4090f21f40 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:12.467593 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-55e88bb0-30b7-4959-9a89-fd4090f21f40 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:12.468164 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-55e88bb0-30b7-4959-9a89-fd4090f21f40 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:12.470710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-55e88bb0-30b7-4959-9a89-fd4090f21f40 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:12.471277 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-55e88bb0-30b7-4959-9a89-fd4090f21f40 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:12.631222 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-55e88bb0-30b7-4959-9a89-fd4090f21f40 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:12.639990 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-55e88bb0-30b7-4959-9a89-fd4090f21f40 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1691 microversion: 2.1 time: 0.189543 May 10 16:53:12.641382 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 317/663] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:12 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1691 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:13.658675 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e823bd1b-da97-4a3a-9ebc-a835eea85be0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:13.659374 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e823bd1b-da97-4a3a-9ebc-a835eea85be0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:13.665952 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e823bd1b-da97-4a3a-9ebc-a835eea85be0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:13.666348 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e823bd1b-da97-4a3a-9ebc-a835eea85be0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:13.667379 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e823bd1b-da97-4a3a-9ebc-a835eea85be0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:13.667663 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e823bd1b-da97-4a3a-9ebc-a835eea85be0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:13.823824 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e823bd1b-da97-4a3a-9ebc-a835eea85be0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:13.831538 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e823bd1b-da97-4a3a-9ebc-a835eea85be0 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1691 microversion: 2.1 time: 0.177311 May 10 16:53:13.832049 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 347/664] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:13 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:14.849164 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-79c2360c-afb2-413d-98d2-cc51a6d14476 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:14.849929 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-79c2360c-afb2-413d-98d2-cc51a6d14476 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:14.857109 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79c2360c-afb2-413d-98d2-cc51a6d14476 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:14.857746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79c2360c-afb2-413d-98d2-cc51a6d14476 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:14.858633 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79c2360c-afb2-413d-98d2-cc51a6d14476 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:14.859336 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-79c2360c-afb2-413d-98d2-cc51a6d14476 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:14.997969 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-79c2360c-afb2-413d-98d2-cc51a6d14476 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:15.006314 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-79c2360c-afb2-413d-98d2-cc51a6d14476 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1691 microversion: 2.1 time: 0.161237 May 10 16:53:15.006884 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 318/665] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:14 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:16.023022 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-01d21822-a67c-412b-ae0f-33783093a2c5 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:16.023639 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-01d21822-a67c-412b-ae0f-33783093a2c5 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:16.030003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-01d21822-a67c-412b-ae0f-33783093a2c5 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:16.030459 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-01d21822-a67c-412b-ae0f-33783093a2c5 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:16.031256 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-01d21822-a67c-412b-ae0f-33783093a2c5 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:16.031685 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-01d21822-a67c-412b-ae0f-33783093a2c5 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:16.224105 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-01d21822-a67c-412b-ae0f-33783093a2c5 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:16.231484 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-01d21822-a67c-412b-ae0f-33783093a2c5 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1691 microversion: 2.1 time: 0.212373 May 10 16:53:16.232053 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 348/666] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:16 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1691 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:17.249045 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-914fd46f-1d21-43a7-adf1-e0747fbac6f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:17.250440 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-914fd46f-1d21-43a7-adf1-e0747fbac6f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:17.257445 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-914fd46f-1d21-43a7-adf1-e0747fbac6f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:17.258145 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-914fd46f-1d21-43a7-adf1-e0747fbac6f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:17.258943 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-914fd46f-1d21-43a7-adf1-e0747fbac6f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:17.259393 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-914fd46f-1d21-43a7-adf1-e0747fbac6f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:17.329304 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-f8201ece-b898-4ded-8a5b-101c1d2abea4 req-0d6117e9-2f2e-4f72-8271-a2cb769388c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061921a1-1ddc-4500-aee0-4cbeb018807f", "name": "network-vif-deleted", "tag": "01f7d055-f780-49f6-98a2-68c108a3aa05"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:17.334542 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-914fd46f-1d21-43a7-adf1-e0747fbac6f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:17.337864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-f8201ece-b898-4ded-8a5b-101c1d2abea4 req-0d6117e9-2f2e-4f72-8271-a2cb769388c3 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:17.338621 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-f8201ece-b898-4ded-8a5b-101c1d2abea4 req-0d6117e9-2f2e-4f72-8271-a2cb769388c3 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:17.345517 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-914fd46f-1d21-43a7-adf1-e0747fbac6f1 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 200 len: 1624 microversion: 2.1 time: 0.100250 May 10 16:53:17.346885 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 319/667] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:17 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 1624 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:17.353343 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-f8201ece-b898-4ded-8a5b-101c1d2abea4 req-0d6117e9-2f2e-4f72-8271-a2cb769388c3 service nova] Creating event network-vif-deleted:01f7d055-f780-49f6-98a2-68c108a3aa05 for instance 061921a1-1ddc-4500-aee0-4cbeb018807f on hv-cinder-83588 May 10 16:53:17.359233 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-f8201ece-b898-4ded-8a5b-101c1d2abea4 req-0d6117e9-2f2e-4f72-8271-a2cb769388c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035136 May 10 16:53:17.360340 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 349/668] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:53:18.362405 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b390798c-5519-41f6-99a5-c702c6d9d849 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:18.363103 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b390798c-5519-41f6-99a5-c702c6d9d849 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: 061921a1-1ddc-4500-aee0-4cbeb018807f] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:18.369492 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b390798c-5519-41f6-99a5-c702c6d9d849 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:18.369949 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b390798c-5519-41f6-99a5-c702c6d9d849 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:18.370733 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b390798c-5519-41f6-99a5-c702c6d9d849 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:18.371173 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b390798c-5519-41f6-99a5-c702c6d9d849 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:18.384793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-b390798c-5519-41f6-99a5-c702c6d9d849 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] HTTP exception thrown: Instance 061921a1-1ddc-4500-aee0-4cbeb018807f could not be found. May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b390798c-5519-41f6-99a5-c702c6d9d849 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Request method failure captured: May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f HTTP/1.1 May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepdJR-AF-Z26xVSih2S5pNsgUpMA9h2-Krw7RrRj8d_QVb-3P4O9A7qASBY6YcTvAlFWYfInVgEslcfuVTs_Qnhf8VRyTXZHu6Hjtdi2GX-INLheW4fBj5cu-AnpIf8NHny2CNDo-adluifJHsQB9ZA56KGMRy71THEq-fiRgcDf_ec May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: f6208c73932343aeae12d8cd0983fc77 May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:53:18.386470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: f6208c73932343aeae12d8cd0983fc77 May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-ServerRescueNegativeTestJSON-1478239847-project May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 4de0f4da2d2e464fb9501fa58e344bed May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478239847-project May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 061921a1-1ddc-4500-aee0-4cbeb018807f could not be found. May 10 16:53:18.388069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '061921a1-1ddc-4500-aee0-4cbeb018807f'} May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061921a1-1ddc-4500-aee0-4cbeb018807f could not be found. May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:53:18.389055 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061921a1-1ddc-4500-aee0-4cbeb018807f could not be found. May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061921a1-1ddc-4500-aee0-4cbeb018807f could not be found. May 10 16:53:18.390835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:18.391955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b390798c-5519-41f6-99a5-c702c6d9d849 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Returning 404 to user: Instance 061921a1-1ddc-4500-aee0-4cbeb018807f could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:53:18.391955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b390798c-5519-41f6-99a5-c702c6d9d849 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f" status: 404 len: 111 microversion: 2.1 time: 0.029714 May 10 16:53:18.391955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 320/669] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:18 2022] GET /compute/v2.1/servers/061921a1-1ddc-4500-aee0-4cbeb018807f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:53:18.398890 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c0c83f22-827e-41b5-8bf5-d5173b888ad4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '.version_select at 0x7f5fb6364d30>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:18.418164 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c0c83f22-827e-41b5-8bf5-d5173b888ad4 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141403721" status: 202 len: 0 microversion: 2.1 time: 0.023441 May 10 16:53:18.418967 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 350/670] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 10 16:53:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141403721 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:53:21.554132 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-005013c0-2823-471f-8f65-41bb3294fa9e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:21.554621 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-005013c0-2823-471f-8f65-41bb3294fa9e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:21.560607 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-005013c0-2823-471f-8f65-41bb3294fa9e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:21.561119 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-005013c0-2823-471f-8f65-41bb3294fa9e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:21.561898 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-005013c0-2823-471f-8f65-41bb3294fa9e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:21.563025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-005013c0-2823-471f-8f65-41bb3294fa9e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:21.587545 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-005013c0-2823-471f-8f65-41bb3294fa9e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:53:21.663987 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-005013c0-2823-471f-8f65-41bb3294fa9e tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 204 len: 0 microversion: 2.1 time: 0.113355 May 10 16:53:21.664606 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 321/671] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:53:21 2022] DELETE /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:53:21.674185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e71e1357-6aea-4da2-a191-1981030c9a7f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:21.675170 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e71e1357-6aea-4da2-a191-1981030c9a7f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:21.681812 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e71e1357-6aea-4da2-a191-1981030c9a7f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:21.682270 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e71e1357-6aea-4da2-a191-1981030c9a7f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:21.683045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e71e1357-6aea-4da2-a191-1981030c9a7f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:21.683483 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e71e1357-6aea-4da2-a191-1981030c9a7f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:21.813791 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e71e1357-6aea-4da2-a191-1981030c9a7f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:21.821019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e71e1357-6aea-4da2-a191-1981030c9a7f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1508 microversion: 2.1 time: 0.151974 May 10 16:53:21.821605 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 351/672] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:21 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:53:22.838918 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4ae0f24e-cec6-40d2-8f11-b3c6d2fc2297 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:22.839523 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4ae0f24e-cec6-40d2-8f11-b3c6d2fc2297 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:22.845918 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4ae0f24e-cec6-40d2-8f11-b3c6d2fc2297 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:22.846362 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4ae0f24e-cec6-40d2-8f11-b3c6d2fc2297 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:22.847121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4ae0f24e-cec6-40d2-8f11-b3c6d2fc2297 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:22.847564 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4ae0f24e-cec6-40d2-8f11-b3c6d2fc2297 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:22.979248 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4ae0f24e-cec6-40d2-8f11-b3c6d2fc2297 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:22.987159 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4ae0f24e-cec6-40d2-8f11-b3c6d2fc2297 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1508 microversion: 2.1 time: 0.152506 May 10 16:53:22.987720 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 322/673] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:22 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:24.003880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7a70fe84-77b8-48b8-b249-e99a9ecdd9ff tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:24.004523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7a70fe84-77b8-48b8-b249-e99a9ecdd9ff tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:24.010925 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a70fe84-77b8-48b8-b249-e99a9ecdd9ff tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:24.011362 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a70fe84-77b8-48b8-b249-e99a9ecdd9ff tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:24.012124 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a70fe84-77b8-48b8-b249-e99a9ecdd9ff tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:24.012583 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7a70fe84-77b8-48b8-b249-e99a9ecdd9ff tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:24.146004 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-7a70fe84-77b8-48b8-b249-e99a9ecdd9ff tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:24.153317 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7a70fe84-77b8-48b8-b249-e99a9ecdd9ff tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1508 microversion: 2.1 time: 0.153851 May 10 16:53:24.153879 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 352/674] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:23 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:24.751550 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-952e9152-d088-48e2-8e41-63af52d20a42 req-9897396b-7763-429b-874a-886b9e3741d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec359fa-52db-434d-8b29-f0d796faf8c0", "name": "network-vif-deleted", "tag": "9159b071-bf14-4943-ad14-db670af07144"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:24.761363 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-952e9152-d088-48e2-8e41-63af52d20a42 req-9897396b-7763-429b-874a-886b9e3741d3 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:24.761800 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-952e9152-d088-48e2-8e41-63af52d20a42 req-9897396b-7763-429b-874a-886b9e3741d3 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:24.774841 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-952e9152-d088-48e2-8e41-63af52d20a42 req-9897396b-7763-429b-874a-886b9e3741d3 service nova] Creating event network-vif-deleted:9159b071-bf14-4943-ad14-db670af07144 for instance dec359fa-52db-434d-8b29-f0d796faf8c0 on hv-cinder-83588 May 10 16:53:24.780363 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-952e9152-d088-48e2-8e41-63af52d20a42 req-9897396b-7763-429b-874a-886b9e3741d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033921 May 10 16:53:24.782121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 323/675] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:25.170507 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:25.171630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:25.179064 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:25.179064 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:25.179771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:25.180208 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:25.214504 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:25.215257 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:25.215856 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lazy-loading 'fault' on Instance uuid dec359fa-52db-434d-8b29-f0d796faf8c0 {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:53:25.261542 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:25.272023 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5f24c7eb-d0a7-473f-9a05-be67b4a97b42 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 200 len: 1312 microversion: 2.1 time: 0.105089 May 10 16:53:25.273089 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 353/676] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:25 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:26.290803 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-35047eaf-8536-49fa-a209-18d7f1757394 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:26.291493 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-35047eaf-8536-49fa-a209-18d7f1757394 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: dec359fa-52db-434d-8b29-f0d796faf8c0] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:26.297805 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-35047eaf-8536-49fa-a209-18d7f1757394 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:26.298243 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-35047eaf-8536-49fa-a209-18d7f1757394 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:26.299002 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-35047eaf-8536-49fa-a209-18d7f1757394 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:26.299436 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-35047eaf-8536-49fa-a209-18d7f1757394 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:26.314078 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-35047eaf-8536-49fa-a209-18d7f1757394 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] HTTP exception thrown: Instance dec359fa-52db-434d-8b29-f0d796faf8c0 could not be found. May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-35047eaf-8536-49fa-a209-18d7f1757394 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Request method failure captured: May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 HTTP/1.1 May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepdJR-AF-Z26xVSih2S5pNsgUpMA9h2-Krw7RrRj8d_QVb-3P4O9A7qASBY6YcTvAlFWYfInVgEslcfuVTs_Qnhf8VRyTXZHu6Hjtdi2GX-INLheW4fBj5cu-AnpIf8NHny2CNDo-adluifJHsQB9ZA56KGMRy71THEq-fiRgcDf_ec May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: f6208c73932343aeae12d8cd0983fc77 May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:53:26.315847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: f6208c73932343aeae12d8cd0983fc77 May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-ServerRescueNegativeTestJSON-1478239847-project May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 4de0f4da2d2e464fb9501fa58e344bed May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478239847-project May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance dec359fa-52db-434d-8b29-f0d796faf8c0 could not be found. May 10 16:53:26.318529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': 'dec359fa-52db-434d-8b29-f0d796faf8c0'} May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec359fa-52db-434d-8b29-f0d796faf8c0 could not be found. May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:53:26.320033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec359fa-52db-434d-8b29-f0d796faf8c0 could not be found. May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec359fa-52db-434d-8b29-f0d796faf8c0 could not be found. May 10 16:53:26.322665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:26.325011 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-35047eaf-8536-49fa-a209-18d7f1757394 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Returning 404 to user: Instance dec359fa-52db-434d-8b29-f0d796faf8c0 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:53:26.325011 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-35047eaf-8536-49fa-a209-18d7f1757394 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0" status: 404 len: 111 microversion: 2.1 time: 0.031831 May 10 16:53:26.325011 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 324/677] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:26 2022] GET /compute/v2.1/servers/dec359fa-52db-434d-8b29-f0d796faf8c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:53:26.329777 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ec96b815-effd-4991-984b-c3329262ec66 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:26.330273 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ec96b815-effd-4991-984b-c3329262ec66 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:26.336955 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ec96b815-effd-4991-984b-c3329262ec66 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:26.337396 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ec96b815-effd-4991-984b-c3329262ec66 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:26.338166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ec96b815-effd-4991-984b-c3329262ec66 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:26.338623 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ec96b815-effd-4991-984b-c3329262ec66 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:26.367076 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ec96b815-effd-4991-984b-c3329262ec66 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Going to try to terminate instance {{(pid=134195) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:53:26.446847 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ec96b815-effd-4991-984b-c3329262ec66 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 204 len: 0 microversion: 2.1 time: 0.121564 May 10 16:53:26.447549 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 354/678] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:53:26 2022] DELETE /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:53:26.457354 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-67ec6440-df42-40e0-88cc-12fcf0b5a16f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:26.457977 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-67ec6440-df42-40e0-88cc-12fcf0b5a16f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:26.463903 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-67ec6440-df42-40e0-88cc-12fcf0b5a16f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:26.464394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-67ec6440-df42-40e0-88cc-12fcf0b5a16f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:26.465171 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-67ec6440-df42-40e0-88cc-12fcf0b5a16f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:26.465612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-67ec6440-df42-40e0-88cc-12fcf0b5a16f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:26.630164 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-67ec6440-df42-40e0-88cc-12fcf0b5a16f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:26.637507 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-67ec6440-df42-40e0-88cc-12fcf0b5a16f tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.185357 May 10 16:53:26.638072 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 325/679] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:26 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:27.655310 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-bd3e71af-64b4-41a5-ac72-b030f3ab2494 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:27.656598 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-bd3e71af-64b4-41a5-ac72-b030f3ab2494 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:27.663023 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd3e71af-64b4-41a5-ac72-b030f3ab2494 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:27.663477 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd3e71af-64b4-41a5-ac72-b030f3ab2494 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:27.664259 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd3e71af-64b4-41a5-ac72-b030f3ab2494 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:27.664721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd3e71af-64b4-41a5-ac72-b030f3ab2494 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:27.795135 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bd3e71af-64b4-41a5-ac72-b030f3ab2494 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:27.803047 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-bd3e71af-64b4-41a5-ac72-b030f3ab2494 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.151878 May 10 16:53:27.803635 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 355/680] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:27 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:28.820875 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a36d7044-52f2-41d7-9a80-1b789155eddd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:28.821412 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a36d7044-52f2-41d7-9a80-1b789155eddd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:28.828033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a36d7044-52f2-41d7-9a80-1b789155eddd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:28.828517 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a36d7044-52f2-41d7-9a80-1b789155eddd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:28.829310 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a36d7044-52f2-41d7-9a80-1b789155eddd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:28.829751 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a36d7044-52f2-41d7-9a80-1b789155eddd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:28.968763 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a36d7044-52f2-41d7-9a80-1b789155eddd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:28.976742 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a36d7044-52f2-41d7-9a80-1b789155eddd tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.159786 May 10 16:53:28.977319 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 326/681] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:28 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:29.994527 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4ab243a1-52e2-4be4-8175-24df236f4881 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:29.995320 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4ab243a1-52e2-4be4-8175-24df236f4881 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:30.003261 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4ab243a1-52e2-4be4-8175-24df236f4881 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:30.003721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4ab243a1-52e2-4be4-8175-24df236f4881 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:30.004540 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4ab243a1-52e2-4be4-8175-24df236f4881 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:30.004985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4ab243a1-52e2-4be4-8175-24df236f4881 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:30.151201 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4ab243a1-52e2-4be4-8175-24df236f4881 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4de0f4da2d2e464fb9501fa58e344bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6208c73932343aeae12d8cd0983fc77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:30.158864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4ab243a1-52e2-4be4-8175-24df236f4881 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 200 len: 1523 microversion: 2.1 time: 0.168176 May 10 16:53:30.159456 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 356/682] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:29 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:30.828693 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-8f25cb3e-de19-4d5f-acf2-f6c61949419c req-eb1a91e3-6c91-427b-a6cc-1e9fb64ca4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82b30ce-5490-4df6-8d9e-12bf93154ae8", "name": "network-vif-deleted", "tag": "2e36c520-ea08-4d13-beae-c69470ab57c8"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:30.837683 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-8f25cb3e-de19-4d5f-acf2-f6c61949419c req-eb1a91e3-6c91-427b-a6cc-1e9fb64ca4ef service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:30.838217 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-8f25cb3e-de19-4d5f-acf2-f6c61949419c req-eb1a91e3-6c91-427b-a6cc-1e9fb64ca4ef service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:30.849841 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-8f25cb3e-de19-4d5f-acf2-f6c61949419c req-eb1a91e3-6c91-427b-a6cc-1e9fb64ca4ef service nova] Creating event network-vif-deleted:2e36c520-ea08-4d13-beae-c69470ab57c8 for instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 on hv-cinder-83588 May 10 16:53:30.854756 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-8f25cb3e-de19-4d5f-acf2-f6c61949419c req-eb1a91e3-6c91-427b-a6cc-1e9fb64ca4ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235536 May 10 16:53:30.855341 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 327/683] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:31.177775 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2367082b-8733-4e1f-b732-a9ea037ddd79 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:31.178384 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2367082b-8733-4e1f-b732-a9ea037ddd79 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] [instance: c82b30ce-5490-4df6-8d9e-12bf93154ae8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:31.185155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2367082b-8733-4e1f-b732-a9ea037ddd79 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:31.185707 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2367082b-8733-4e1f-b732-a9ea037ddd79 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:31.187018 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2367082b-8733-4e1f-b732-a9ea037ddd79 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:31.187627 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2367082b-8733-4e1f-b732-a9ea037ddd79 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:31.202939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-2367082b-8733-4e1f-b732-a9ea037ddd79 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] HTTP exception thrown: Instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 could not be found. May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2367082b-8733-4e1f-b732-a9ea037ddd79 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Request method failure captured: May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 HTTP/1.1 May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdJR-AF-Z26xVSih2S5pNsgUpMA9h2-Krw7RrRj8d_QVb-3P4O9A7qASBY6YcTvAlFWYfInVgEslcfuVTs_Qnhf8VRyTXZHu6Hjtdi2GX-INLheW4fBj5cu-AnpIf8NHny2CNDo-adluifJHsQB9ZA56KGMRy71THEq-fiRgcDf_ec May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: f6208c73932343aeae12d8cd0983fc77 May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:53:31.204642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6208c73932343aeae12d8cd0983fc77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: f6208c73932343aeae12d8cd0983fc77 May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478239847 May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-ServerRescueNegativeTestJSON-1478239847-project May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 4de0f4da2d2e464fb9501fa58e344bed May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478239847-project May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 could not be found. May 10 16:53:31.207142 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'c82b30ce-5490-4df6-8d9e-12bf93154ae8'} May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 could not be found. May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:53:31.208779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 could not be found. May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 could not be found. May 10 16:53:31.211808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:53:31.214143 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2367082b-8733-4e1f-b732-a9ea037ddd79 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] Returning 404 to user: Instance c82b30ce-5490-4df6-8d9e-12bf93154ae8 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:53:31.214143 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2367082b-8733-4e1f-b732-a9ea037ddd79 tempest-ServerRescueNegativeTestJSON-1478239847 tempest-ServerRescueNegativeTestJSON-1478239847-project] 10.222.0.48 "GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8" status: 404 len: 111 microversion: 2.1 time: 0.033126 May 10 16:53:31.214143 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 357/684] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:31 2022] GET /compute/v2.1/servers/c82b30ce-5490-4df6-8d9e-12bf93154ae8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:53:37.697589 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-715d1706-7b32-4587-afd8-4626595b04f6 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fb6bcddc0>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:37.746611 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-715d1706-7b32-4587-afd8-4626595b04f6 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/05d25b0e-7991-4403-b4bc-58ff36e8100a" status: 200 len: 350 microversion: 2.1 time: 0.054108 May 10 16:53:37.747179 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 328/685] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:53:37 2022] GET /compute/v2.1/os-volumes/05d25b0e-7991-4403-b4bc-58ff36e8100a => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:53:38.867755 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-aae209e2-3e6a-4da8-9b86-6c0fc53eb9aa tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1699835636"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:38.868383 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-aae209e2-3e6a-4da8-9b86-6c0fc53eb9aa tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:38.875503 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aae209e2-3e6a-4da8-9b86-6c0fc53eb9aa tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:38.876055 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aae209e2-3e6a-4da8-9b86-6c0fc53eb9aa tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:38.876763 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aae209e2-3e6a-4da8-9b86-6c0fc53eb9aa tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:38.877196 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aae209e2-3e6a-4da8-9b86-6c0fc53eb9aa tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:39.014632 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.network.security_group_api [None req-aae209e2-3e6a-4da8-9b86-6c0fc53eb9aa tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Removing security group 7d7dbe47-73cd-401e-ad9c-f0ec589bae2c from port b30dc8d6-b194-432b-996f-a760a67504fc May 10 16:53:39.117332 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-26d5bb0d-0c5e-4d25-aeb2-a21542f0d3e3 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fb6b2a3a0>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:39.173604 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-26d5bb0d-0c5e-4d25-aeb2-a21542f0d3e3 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d7dfbd82-29b2-4e93-a52f-72a42bacab52" status: 200 len: 351 microversion: 2.1 time: 0.060229 May 10 16:53:39.174904 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 329/686] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:53:39 2022] GET /compute/v2.1/os-volumes/d7dfbd82-29b2-4e93-a52f-72a42bacab52 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:53:39.449649 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-aae209e2-3e6a-4da8-9b86-6c0fc53eb9aa tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "POST /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.585361 May 10 16:53:39.453925 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 358/687] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 16:53:38 2022] POST /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:53:39.469303 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-40b62c76-b170-4984-92c1-b05450cd4629 req-999e483c-0bc7-4a53-8a61-620abcbc2c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f5143e-66c5-4637-b754-ae72952cc5ae", "tag": "b30dc8d6-b194-432b-996f-a760a67504fc"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:39.487170 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-40b62c76-b170-4984-92c1-b05450cd4629 req-999e483c-0bc7-4a53-8a61-620abcbc2c0f service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:39.488079 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-40b62c76-b170-4984-92c1-b05450cd4629 req-999e483c-0bc7-4a53-8a61-620abcbc2c0f service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:39.513094 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-40b62c76-b170-4984-92c1-b05450cd4629 req-999e483c-0bc7-4a53-8a61-620abcbc2c0f service nova] Creating event network-changed:b30dc8d6-b194-432b-996f-a760a67504fc for instance 25f5143e-66c5-4637-b754-ae72952cc5ae on hv-cinder-83588 May 10 16:53:39.525955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-40b62c76-b170-4984-92c1-b05450cd4629 req-999e483c-0bc7-4a53-8a61-620abcbc2c0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063471 May 10 16:53:39.529196 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 330/688] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:40.570546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4a78df2e-a095-4441-a0ec-18675914caeb tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fbc0665e0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:40.637271 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4a78df2e-a095-4441-a0ec-18675914caeb tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/ba74d28a-f89f-4bba-8d78-b3d0232554a7" status: 200 len: 351 microversion: 2.1 time: 0.070884 May 10 16:53:40.645476 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 359/689] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:53:40 2022] GET /compute/v2.1/os-volumes/ba74d28a-f89f-4bba-8d78-b3d0232554a7 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:40.652636 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4cce1b3b-0363-4a05-a195-65e48fec44a7 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fb6b2a9d0>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:40.755323 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4cce1b3b-0363-4a05-a195-65e48fec44a7 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.108049 May 10 16:53:40.756714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 331/690] 10.222.0.48 () {58 vars in 1133 bytes} [Tue May 10 16:53:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:40.773653 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-14219cc1-1adc-46f4-956a-57e7f914907b tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fb639e1f0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:40.875695 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-14219cc1-1adc-46f4-956a-57e7f914907b tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.105930 May 10 16:53:40.876302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 360/691] 10.222.0.48 () {58 vars in 1148 bytes} [Tue May 10 16:53:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:40.891844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9ccc18fa-b799-43c0-86b0-b60d977264ef tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fb6affca0>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:41.007515 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9ccc18fa-b799-43c0-86b0-b60d977264ef tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.122826 May 10 16:53:41.008170 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 332/692] 10.222.0.48 () {58 vars in 1133 bytes} [Tue May 10 16:53:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:41.021203 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-52540614-33e8-41ee-9abf-af3e01be94c9 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fb63ee280>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:41.105068 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-52540614-33e8-41ee-9abf-af3e01be94c9 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088874 May 10 16:53:41.105665 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 361/693] 10.222.0.48 () {58 vars in 1166 bytes} [Tue May 10 16:53:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:53:41.118594 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c4f575bc-d841-4843-9fc5-d2ef2006383f tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fb6abe0d0>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:41.220584 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c4f575bc-d841-4843-9fc5-d2ef2006383f tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.106593 May 10 16:53:41.221431 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 333/694] 10.222.0.48 () {58 vars in 1169 bytes} [Tue May 10 16:53:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:41.235372 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d3124568-472d-41e8-aa00-e4d8fe33e996 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fb6364280>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:41.241381 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-52a20552-05de-484e-93b3-77ecd7b1f9c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:41.242714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-52a20552-05de-484e-93b3-77ecd7b1f9c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:41.253123 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-52a20552-05de-484e-93b3-77ecd7b1f9c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:41.253698 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-52a20552-05de-484e-93b3-77ecd7b1f9c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:41.255041 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-52a20552-05de-484e-93b3-77ecd7b1f9c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:41.255642 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-52a20552-05de-484e-93b3-77ecd7b1f9c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:41.357671 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d3124568-472d-41e8-aa00-e4d8fe33e996 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.126980 May 10 16:53:41.358724 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 362/695] 10.222.0.48 () {58 vars in 1154 bytes} [Tue May 10 16:53:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:41.365313 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-52a20552-05de-484e-93b3-77ecd7b1f9c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lazy-loading 'services' on Instance uuid 25f5143e-66c5-4637-b754-ae72952cc5ae {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:53:41.374859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-50716fa8-7a37-4239-9098-7b14704df958 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fb6380b80>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:41.462639 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-52a20552-05de-484e-93b3-77ecd7b1f9c6 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "DELETE /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments/760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5" status: 202 len: 0 microversion: 2.1 time: 0.226198 May 10 16:53:41.463244 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 334/696] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:53:41 2022] DELETE /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments/760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 16:53:41.475346 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-50716fa8-7a37-4239-9098-7b14704df958 tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.106646 May 10 16:53:41.477061 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 363/697] 10.222.0.48 () {58 vars in 1187 bytes} [Tue May 10 16:53:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:41.482277 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a1a465e8-38c1-45c9-8a5d-e9bc35fd7b9f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:41.484188 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a1a465e8-38c1-45c9-8a5d-e9bc35fd7b9f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:41.492174 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a1a465e8-38c1-45c9-8a5d-e9bc35fd7b9f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:41.492844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a1a465e8-38c1-45c9-8a5d-e9bc35fd7b9f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:41.493722 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a1a465e8-38c1-45c9-8a5d-e9bc35fd7b9f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:41.494255 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a1a465e8-38c1-45c9-8a5d-e9bc35fd7b9f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:41.494559 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5db90b52-bbad-4312-976a-1ecf47e2f12b tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] Calling method '.version_select at 0x7f5fb63a7550>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:41.535496 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a1a465e8-38c1-45c9-8a5d-e9bc35fd7b9f tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061296 May 10 16:53:41.539983 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 335/698] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:53:41 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:41.551759 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-9f76315e-deb0-4180-b2ca-da65a60718a5 req-1ee76687-ad92-4618-a4c7-d32f2b9737c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f5143e-66c5-4637-b754-ae72952cc5ae", "tag": "b30dc8d6-b194-432b-996f-a760a67504fc"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:41.560845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-9f76315e-deb0-4180-b2ca-da65a60718a5 req-1ee76687-ad92-4618-a4c7-d32f2b9737c3 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:41.562122 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-9f76315e-deb0-4180-b2ca-da65a60718a5 req-1ee76687-ad92-4618-a4c7-d32f2b9737c3 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:41.581200 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-9f76315e-deb0-4180-b2ca-da65a60718a5 req-1ee76687-ad92-4618-a4c7-d32f2b9737c3 service nova] Creating event network-changed:b30dc8d6-b194-432b-996f-a760a67504fc for instance 25f5143e-66c5-4637-b754-ae72952cc5ae on hv-cinder-83588 May 10 16:53:41.587459 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-9f76315e-deb0-4180-b2ca-da65a60718a5 req-1ee76687-ad92-4618-a4c7-d32f2b9737c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039747 May 10 16:53:41.588201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 336/699] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:41.665096 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5db90b52-bbad-4312-976a-1ecf47e2f12b tempest-VolumesTestJSON-1681805957 tempest-VolumesTestJSON-1681805957-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.176058 May 10 16:53:41.666785 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 364/700] 10.222.0.48 () {58 vars in 1154 bytes} [Tue May 10 16:53:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:42.548922 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3ae1710e-069b-4b0c-92c4-4e7c91a03419 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:42.550195 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3ae1710e-069b-4b0c-92c4-4e7c91a03419 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:42.556579 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3ae1710e-069b-4b0c-92c4-4e7c91a03419 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:42.556971 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3ae1710e-069b-4b0c-92c4-4e7c91a03419 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:42.557731 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3ae1710e-069b-4b0c-92c4-4e7c91a03419 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:42.558165 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3ae1710e-069b-4b0c-92c4-4e7c91a03419 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:42.587369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3ae1710e-069b-4b0c-92c4-4e7c91a03419 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043920 May 10 16:53:42.587951 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 337/701] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:53:42 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:53:42.599155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f49dabe3-d857-45be-8065-244e0bf54b7b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:42.599654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f49dabe3-d857-45be-8065-244e0bf54b7b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:42.605814 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f49dabe3-d857-45be-8065-244e0bf54b7b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:42.606270 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f49dabe3-d857-45be-8065-244e0bf54b7b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:42.607094 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f49dabe3-d857-45be-8065-244e0bf54b7b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:42.607518 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f49dabe3-d857-45be-8065-244e0bf54b7b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:42.682453 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-f49dabe3-d857-45be-8065-244e0bf54b7b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] HTTP exception thrown: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae is not attached to volume 760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5 May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f49dabe3-d857-45be-8065-244e0bf54b7b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Request method failure captured: May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: DELETE /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments/760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5 HTTP/1.1 May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepfvdweDAEXBeKeH-NtLKOLIa1cQyLiwf-0tauvSU6qHVwvLyGu9yze2RLLfdyfDFd5Kdc31kM7-bl0AQ2bXsEmkHnhpB6inRUropl6W_uJVTg0Up-rE2BccHxdFCu9P0itrumVG6YBKDLXYnJf86Vq0EN44XfYE78FpvNcwOAwzBko May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: ad2249e85fd741258c91142e19edc714 May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-TestMinimumBasicScenario-253259930 May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:53:42.687134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ad2249e85fd741258c91142e19edc714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ad2249e85fd741258c91142e19edc714"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ad2249e85fd741258c91142e19edc714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ad2249e85fd741258c91142e19edc714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-TestMinimumBasicScenario-253259930 May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: ad2249e85fd741258c91142e19edc714 May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-TestMinimumBasicScenario-253259930 May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-TestMinimumBasicScenario-253259930-project May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: a0aa3cf87a4c4c67a5c8a458f81ef61c May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-TestMinimumBasicScenario-253259930-project May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:53:42.689744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae is not attached to volume 760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5 May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'server_id': '25f5143e-66c5-4637-b754-ae72952cc5ae', 'id': '760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5'} May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5. May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:53:42.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae is not attached to volume 760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5 May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae is not attached to volume 760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5 May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:53:42.694033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f49dabe3-d857-45be-8065-244e0bf54b7b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Returning 404 to user: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae is not attached to volume 760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5 {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:53:42.695735 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f49dabe3-d857-45be-8065-244e0bf54b7b tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "DELETE /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments/760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5" status: 404 len: 154 microversion: 2.1 time: 0.093982 May 10 16:53:42.695735 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 365/702] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:53:42 2022] DELETE /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae/os-volume_attachments/760cbfd4-c2e9-4d0c-b46e-0f8ec147abf5 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:53:43.832546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f9bb6cce-8b23-4869-810e-a4c9c5c37dc7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:43.833113 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f9bb6cce-8b23-4869-810e-a4c9c5c37dc7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:43.839358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f9bb6cce-8b23-4869-810e-a4c9c5c37dc7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:43.839811 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f9bb6cce-8b23-4869-810e-a4c9c5c37dc7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:43.840619 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f9bb6cce-8b23-4869-810e-a4c9c5c37dc7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:43.841060 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f9bb6cce-8b23-4869-810e-a4c9c5c37dc7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:43.867317 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f9bb6cce-8b23-4869-810e-a4c9c5c37dc7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:53:43.941957 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f9bb6cce-8b23-4869-810e-a4c9c5c37dc7 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "DELETE /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 204 len: 0 microversion: 2.1 time: 0.113100 May 10 16:53:43.942548 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 338/703] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:53:43 2022] DELETE /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:53:43.950653 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ce34f893-7f20-40b5-ac29-0d5d5b16b0ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:43.951812 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ce34f893-7f20-40b5-ac29-0d5d5b16b0ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:43.958469 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce34f893-7f20-40b5-ac29-0d5d5b16b0ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:43.958927 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce34f893-7f20-40b5-ac29-0d5d5b16b0ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:43.959704 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce34f893-7f20-40b5-ac29-0d5d5b16b0ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:43.960147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce34f893-7f20-40b5-ac29-0d5d5b16b0ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:44.110023 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ce34f893-7f20-40b5-ac29-0d5d5b16b0ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:44.117300 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ce34f893-7f20-40b5-ac29-0d5d5b16b0ce tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1554 microversion: 2.1 time: 0.170453 May 10 16:53:44.117862 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 366/704] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:43 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:45.135359 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d9b21ffc-1307-483f-a83c-5a198be658b1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:45.136085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d9b21ffc-1307-483f-a83c-5a198be658b1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:45.142736 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d9b21ffc-1307-483f-a83c-5a198be658b1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:45.143189 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d9b21ffc-1307-483f-a83c-5a198be658b1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:45.143961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d9b21ffc-1307-483f-a83c-5a198be658b1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:45.144419 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d9b21ffc-1307-483f-a83c-5a198be658b1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:45.314507 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d9b21ffc-1307-483f-a83c-5a198be658b1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:45.322111 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d9b21ffc-1307-483f-a83c-5a198be658b1 tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1554 microversion: 2.1 time: 0.190854 May 10 16:53:45.322690 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 339/705] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:45 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:53:46.343840 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9fbaf052-8585-450c-8eef-9524119f9dcc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:46.344520 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9fbaf052-8585-450c-8eef-9524119f9dcc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:46.349515 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-6e3820e1-4bdd-4029-8fb8-a65a85a5cf3c req-62035fb5-20cf-4d45-8f1a-1894e9fe3e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f5143e-66c5-4637-b754-ae72952cc5ae", "name": "network-vif-deleted", "tag": "b30dc8d6-b194-432b-996f-a760a67504fc"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:46.356407 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9fbaf052-8585-450c-8eef-9524119f9dcc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:46.357158 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9fbaf052-8585-450c-8eef-9524119f9dcc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:46.362376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-6e3820e1-4bdd-4029-8fb8-a65a85a5cf3c req-62035fb5-20cf-4d45-8f1a-1894e9fe3e48 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:46.362636 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9fbaf052-8585-450c-8eef-9524119f9dcc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:46.363283 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9fbaf052-8585-450c-8eef-9524119f9dcc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:46.364532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-6e3820e1-4bdd-4029-8fb8-a65a85a5cf3c req-62035fb5-20cf-4d45-8f1a-1894e9fe3e48 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:46.379603 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-6e3820e1-4bdd-4029-8fb8-a65a85a5cf3c req-62035fb5-20cf-4d45-8f1a-1894e9fe3e48 service nova] Creating event network-vif-deleted:b30dc8d6-b194-432b-996f-a760a67504fc for instance 25f5143e-66c5-4637-b754-ae72952cc5ae on hv-cinder-83588 May 10 16:53:46.387096 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-6e3820e1-4bdd-4029-8fb8-a65a85a5cf3c req-62035fb5-20cf-4d45-8f1a-1894e9fe3e48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044966 May 10 16:53:46.387827 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 340/706] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:46.450268 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9fbaf052-8585-450c-8eef-9524119f9dcc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0aa3cf87a4c4c67a5c8a458f81ef61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2249e85fd741258c91142e19edc714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:46.459381 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9fbaf052-8585-450c-8eef-9524119f9dcc tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 200 len: 1512 microversion: 2.1 time: 0.121751 May 10 16:53:46.460653 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 367/707] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:46 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 1512 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:53:47.479860 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-67c50855-9149-496f-b5d4-63d9ee0a45ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:47.480984 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-67c50855-9149-496f-b5d4-63d9ee0a45ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] [instance: 25f5143e-66c5-4637-b754-ae72952cc5ae] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:47.488562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-67c50855-9149-496f-b5d4-63d9ee0a45ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:47.489371 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-67c50855-9149-496f-b5d4-63d9ee0a45ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:47.490699 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-67c50855-9149-496f-b5d4-63d9ee0a45ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:47.491443 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-67c50855-9149-496f-b5d4-63d9ee0a45ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:47.507648 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-67c50855-9149-496f-b5d4-63d9ee0a45ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] HTTP exception thrown: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae could not be found. May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-67c50855-9149-496f-b5d4-63d9ee0a45ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Request method failure captured: May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae HTTP/1.1 May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepfvdweDAEXBeKeH-NtLKOLIa1cQyLiwf-0tauvSU6qHVwvLyGu9yze2RLLfdyfDFd5Kdc31kM7-bl0AQ2bXsEmkHnhpB6inRUropl6W_uJVTg0Up-rE2BccHxdFCu9P0itrumVG6YBKDLXYnJf86Vq0EN44XfYE78FpvNcwOAwzBko May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: ad2249e85fd741258c91142e19edc714 May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-TestMinimumBasicScenario-253259930 May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:53:47.509819 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ad2249e85fd741258c91142e19edc714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ad2249e85fd741258c91142e19edc714"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ad2249e85fd741258c91142e19edc714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ad2249e85fd741258c91142e19edc714"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-TestMinimumBasicScenario-253259930 May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: ad2249e85fd741258c91142e19edc714 May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-TestMinimumBasicScenario-253259930 May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-TestMinimumBasicScenario-253259930-project May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: a0aa3cf87a4c4c67a5c8a458f81ef61c May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-TestMinimumBasicScenario-253259930-project May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae could not be found. May 10 16:53:47.511418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '25f5143e-66c5-4637-b754-ae72952cc5ae'} May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae could not be found. May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:53:47.512360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae could not be found. May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae could not be found. May 10 16:53:47.513813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:53:47.515827 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-67c50855-9149-496f-b5d4-63d9ee0a45ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Returning 404 to user: Instance 25f5143e-66c5-4637-b754-ae72952cc5ae could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:53:47.515827 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-67c50855-9149-496f-b5d4-63d9ee0a45ad tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae" status: 404 len: 111 microversion: 2.1 time: 0.037340 May 10 16:53:47.515827 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 341/708] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:53:47 2022] GET /compute/v2.1/servers/25f5143e-66c5-4637-b754-ae72952cc5ae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 16:53:47.521869 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b31158a9-619d-4353-a34e-29e18211f60a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] Calling method '.version_select at 0x7f5fb657aca0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:47.544387 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b31158a9-619d-4353-a34e-29e18211f60a tempest-TestMinimumBasicScenario-253259930 tempest-TestMinimumBasicScenario-253259930-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-658794165" status: 202 len: 0 microversion: 2.1 time: 0.026660 May 10 16:53:47.544975 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 368/709] 10.222.0.48 () {58 vars in 1268 bytes} [Tue May 10 16:53:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-658794165 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:53:53.773811 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7f56a4fc-2a50-4ad1-8553-70970c0b4076 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:53.774327 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7f56a4fc-2a50-4ad1-8553-70970c0b4076 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:53.780994 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7f56a4fc-2a50-4ad1-8553-70970c0b4076 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:53.781661 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7f56a4fc-2a50-4ad1-8553-70970c0b4076 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:53.782519 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7f56a4fc-2a50-4ad1-8553-70970c0b4076 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:53.782962 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7f56a4fc-2a50-4ad1-8553-70970c0b4076 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:53.807921 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7f56a4fc-2a50-4ad1-8553-70970c0b4076 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/ips" status: 200 len: 147 microversion: 2.1 time: 0.224402 May 10 16:53:53.808394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 342/710] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 10 16:53:53 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/ips => generated 147 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:55.205659 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e6578060-7bcd-483c-97b9-3c1e3afc93c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cccb453-1fb5-42de-ac50-109d6c935f04"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:55.206713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e6578060-7bcd-483c-97b9-3c1e3afc93c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:55.214020 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e6578060-7bcd-483c-97b9-3c1e3afc93c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:55.214618 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e6578060-7bcd-483c-97b9-3c1e3afc93c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:55.215448 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e6578060-7bcd-483c-97b9-3c1e3afc93c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:55.215899 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e6578060-7bcd-483c-97b9-3c1e3afc93c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:55.550663 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e6578060-7bcd-483c-97b9-3c1e3afc93c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350376 May 10 16:53:55.551219 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 369/711] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:53:55 2022] POST /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:55.774471 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8f3e0431-6ca2-4e52-8919-9d05a5cf8113 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:55.774960 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8f3e0431-6ca2-4e52-8919-9d05a5cf8113 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:55.781434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f3e0431-6ca2-4e52-8919-9d05a5cf8113 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:55.781855 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f3e0431-6ca2-4e52-8919-9d05a5cf8113 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:55.782629 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f3e0431-6ca2-4e52-8919-9d05a5cf8113 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:55.783056 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f3e0431-6ca2-4e52-8919-9d05a5cf8113 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:55.807306 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8f3e0431-6ca2-4e52-8919-9d05a5cf8113 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/ips" status: 200 len: 151 microversion: 2.20 time: 0.209198 May 10 16:53:55.807859 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 343/712] 10.222.0.48 () {60 vars in 1288 bytes} [Tue May 10 16:53:55 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/ips => generated 151 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:53:57.690722 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-96c2376e-2a6d-465b-9991-1b91135e8a26 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:53:57.691337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-96c2376e-2a6d-465b-9991-1b91135e8a26 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:57.697520 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-96c2376e-2a6d-465b-9991-1b91135e8a26 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:57.697969 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-96c2376e-2a6d-465b-9991-1b91135e8a26 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:57.698729 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-96c2376e-2a6d-465b-9991-1b91135e8a26 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:57.699162 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-96c2376e-2a6d-465b-9991-1b91135e8a26 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:57.722317 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-96c2376e-2a6d-465b-9991-1b91135e8a26 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lazy-loading 'flavor' on Instance uuid a8c65f78-2474-4331-ad66-738a8ac2162c {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:53:57.993464 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-96c2376e-2a6d-465b-9991-1b91135e8a26 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "POST /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/action" status: 202 len: 0 microversion: 2.20 time: 0.307959 May 10 16:53:57.994118 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 370/713] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 10 16:53:57 2022] POST /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 16:53:58.004469 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d7f5c6ba-1315-45a4-a24d-dbd682c36247 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:58.005074 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d7f5c6ba-1315-45a4-a24d-dbd682c36247 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:58.012696 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7f5c6ba-1315-45a4-a24d-dbd682c36247 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:58.013554 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7f5c6ba-1315-45a4-a24d-dbd682c36247 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:58.015044 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7f5c6ba-1315-45a4-a24d-dbd682c36247 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:58.015488 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d7f5c6ba-1315-45a4-a24d-dbd682c36247 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:58.150515 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d7f5c6ba-1315-45a4-a24d-dbd682c36247 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:58.160125 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d7f5c6ba-1315-45a4-a24d-dbd682c36247 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:58.161714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d7f5c6ba-1315-45a4-a24d-dbd682c36247 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:58.162917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d7f5c6ba-1315-45a4-a24d-dbd682c36247 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.162432 May 10 16:53:58.163510 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 344/714] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:57 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:53:59.185026 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-bce8a358-63a6-44bc-8d0d-3d22de25abaf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:53:59.186438 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-bce8a358-63a6-44bc-8d0d-3d22de25abaf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:53:59.194197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bce8a358-63a6-44bc-8d0d-3d22de25abaf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:59.194765 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bce8a358-63a6-44bc-8d0d-3d22de25abaf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:59.195761 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bce8a358-63a6-44bc-8d0d-3d22de25abaf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:53:59.196308 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bce8a358-63a6-44bc-8d0d-3d22de25abaf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:53:59.338757 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bce8a358-63a6-44bc-8d0d-3d22de25abaf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:59.347280 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bce8a358-63a6-44bc-8d0d-3d22de25abaf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:59.348834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bce8a358-63a6-44bc-8d0d-3d22de25abaf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:53:59.349987 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-bce8a358-63a6-44bc-8d0d-3d22de25abaf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.170948 May 10 16:53:59.350544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 371/715] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:53:59 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:00.367976 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-08a22a92-8a38-431c-9168-ceb41ddb724d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:00.368601 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-08a22a92-8a38-431c-9168-ceb41ddb724d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:00.375701 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-08a22a92-8a38-431c-9168-ceb41ddb724d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:00.376158 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-08a22a92-8a38-431c-9168-ceb41ddb724d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:00.376979 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-08a22a92-8a38-431c-9168-ceb41ddb724d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:00.377453 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-08a22a92-8a38-431c-9168-ceb41ddb724d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:00.504659 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-08a22a92-8a38-431c-9168-ceb41ddb724d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:00.512504 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-08a22a92-8a38-431c-9168-ceb41ddb724d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:00.514500 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-08a22a92-8a38-431c-9168-ceb41ddb724d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:00.515744 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-08a22a92-8a38-431c-9168-ceb41ddb724d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.151567 May 10 16:54:00.516326 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 345/716] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:00 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:01.534613 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f9d93021-1c89-44ec-b3f8-a67dd51caa09 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:01.535326 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f9d93021-1c89-44ec-b3f8-a67dd51caa09 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:01.541757 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f9d93021-1c89-44ec-b3f8-a67dd51caa09 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:01.542214 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f9d93021-1c89-44ec-b3f8-a67dd51caa09 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:01.542987 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f9d93021-1c89-44ec-b3f8-a67dd51caa09 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:01.543425 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f9d93021-1c89-44ec-b3f8-a67dd51caa09 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:01.689993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f9d93021-1c89-44ec-b3f8-a67dd51caa09 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:01.697715 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f9d93021-1c89-44ec-b3f8-a67dd51caa09 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:01.699210 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f9d93021-1c89-44ec-b3f8-a67dd51caa09 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:01.700421 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f9d93021-1c89-44ec-b3f8-a67dd51caa09 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.169728 May 10 16:54:01.701473 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 372/717] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:01 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:02.718222 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5f8e2e00-394d-4e33-809e-63011b9d27ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:02.718831 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5f8e2e00-394d-4e33-809e-63011b9d27ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:02.725402 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5f8e2e00-394d-4e33-809e-63011b9d27ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:02.725864 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5f8e2e00-394d-4e33-809e-63011b9d27ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:02.726654 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5f8e2e00-394d-4e33-809e-63011b9d27ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:02.727089 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5f8e2e00-394d-4e33-809e-63011b9d27ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:02.858658 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-5f8e2e00-394d-4e33-809e-63011b9d27ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:02.866464 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-5f8e2e00-394d-4e33-809e-63011b9d27ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:02.867968 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-5f8e2e00-394d-4e33-809e-63011b9d27ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:02.869139 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-5f8e2e00-394d-4e33-809e-63011b9d27ab tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.154881 May 10 16:54:02.869695 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 346/718] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:02 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:03.102200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-06fe7e38-4979-44c7-899e-a3100bc526c2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:03.103171 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-06fe7e38-4979-44c7-899e-a3100bc526c2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:03.110339 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-06fe7e38-4979-44c7-899e-a3100bc526c2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:03.110767 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-06fe7e38-4979-44c7-899e-a3100bc526c2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:03.111535 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-06fe7e38-4979-44c7-899e-a3100bc526c2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:03.111968 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-06fe7e38-4979-44c7-899e-a3100bc526c2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:03.141852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-06fe7e38-4979-44c7-899e-a3100bc526c2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 May 10 16:54:03.142408 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 373/719] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:54:03 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:54:03.152330 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d90c55dd-47eb-4c45-bda7-000b745a28d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:03.152832 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d90c55dd-47eb-4c45-bda7-000b745a28d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:03.159723 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d90c55dd-47eb-4c45-bda7-000b745a28d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:03.160183 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d90c55dd-47eb-4c45-bda7-000b745a28d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:03.161004 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d90c55dd-47eb-4c45-bda7-000b745a28d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:03.161445 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d90c55dd-47eb-4c45-bda7-000b745a28d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:03.192674 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d90c55dd-47eb-4c45-bda7-000b745a28d2 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments/4cccb453-1fb5-42de-ac50-109d6c935f04" status: 200 len: 194 microversion: 2.1 time: 0.044213 May 10 16:54:03.193254 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 347/720] 10.222.0.48 () {58 vars in 1412 bytes} [Tue May 10 16:54:03 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments/4cccb453-1fb5-42de-ac50-109d6c935f04 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:54:03.886637 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5a957fa4-8090-4150-8ad2-cc9e1b06dd4e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:03.887246 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-5a957fa4-8090-4150-8ad2-cc9e1b06dd4e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:03.893998 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a957fa4-8090-4150-8ad2-cc9e1b06dd4e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:03.894449 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a957fa4-8090-4150-8ad2-cc9e1b06dd4e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:03.895296 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a957fa4-8090-4150-8ad2-cc9e1b06dd4e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:03.895735 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a957fa4-8090-4150-8ad2-cc9e1b06dd4e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:04.023295 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5a957fa4-8090-4150-8ad2-cc9e1b06dd4e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:04.031287 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5a957fa4-8090-4150-8ad2-cc9e1b06dd4e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:04.032825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5a957fa4-8090-4150-8ad2-cc9e1b06dd4e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:04.033982 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5a957fa4-8090-4150-8ad2-cc9e1b06dd4e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.151233 May 10 16:54:04.034535 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 374/721] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:03 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:05.051869 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-53057ea3-b380-43fa-b644-1f05c7dde50e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:05.052512 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-53057ea3-b380-43fa-b644-1f05c7dde50e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:05.058733 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-53057ea3-b380-43fa-b644-1f05c7dde50e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:05.059177 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-53057ea3-b380-43fa-b644-1f05c7dde50e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:05.059927 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-53057ea3-b380-43fa-b644-1f05c7dde50e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:05.060947 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-53057ea3-b380-43fa-b644-1f05c7dde50e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:05.454986 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-53057ea3-b380-43fa-b644-1f05c7dde50e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:05.463120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-53057ea3-b380-43fa-b644-1f05c7dde50e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:05.464651 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-53057ea3-b380-43fa-b644-1f05c7dde50e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:05.465837 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-53057ea3-b380-43fa-b644-1f05c7dde50e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.418115 May 10 16:54:05.466423 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 348/722] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:05 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:06.485599 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-74c4a1cf-86dc-4156-962b-6d8b5b4cab94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:06.486502 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-74c4a1cf-86dc-4156-962b-6d8b5b4cab94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:06.492858 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-74c4a1cf-86dc-4156-962b-6d8b5b4cab94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:06.493349 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-74c4a1cf-86dc-4156-962b-6d8b5b4cab94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:06.494119 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-74c4a1cf-86dc-4156-962b-6d8b5b4cab94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:06.494562 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-74c4a1cf-86dc-4156-962b-6d8b5b4cab94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:06.631977 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6d771a5d-0062-4a09-aef7-60354d172b12 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac7f6585-dac3-4fd7-a1e4-b1d0998e9c22"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:06.633134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6d771a5d-0062-4a09-aef7-60354d172b12 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:06.633522 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-74c4a1cf-86dc-4156-962b-6d8b5b4cab94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:06.639853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6d771a5d-0062-4a09-aef7-60354d172b12 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:06.648423 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6d771a5d-0062-4a09-aef7-60354d172b12 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:06.648423 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6d771a5d-0062-4a09-aef7-60354d172b12 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:06.648423 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6d771a5d-0062-4a09-aef7-60354d172b12 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:06.648786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-74c4a1cf-86dc-4156-962b-6d8b5b4cab94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:06.648786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-74c4a1cf-86dc-4156-962b-6d8b5b4cab94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:06.648786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-74c4a1cf-86dc-4156-962b-6d8b5b4cab94 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.164030 May 10 16:54:06.649817 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 375/723] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:06 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:06.917301 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6d771a5d-0062-4a09-aef7-60354d172b12 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "POST /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289079 May 10 16:54:06.917905 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 349/724] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:54:06 2022] POST /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:54:07.662835 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6106c4e1-ac97-40d2-ad76-df9b52dbf4f6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:07.663443 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6106c4e1-ac97-40d2-ad76-df9b52dbf4f6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:07.670283 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6106c4e1-ac97-40d2-ad76-df9b52dbf4f6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:07.670743 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6106c4e1-ac97-40d2-ad76-df9b52dbf4f6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:07.671526 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6106c4e1-ac97-40d2-ad76-df9b52dbf4f6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:07.671953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6106c4e1-ac97-40d2-ad76-df9b52dbf4f6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:07.817645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6106c4e1-ac97-40d2-ad76-df9b52dbf4f6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:07.829755 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6106c4e1-ac97-40d2-ad76-df9b52dbf4f6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:07.832205 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6106c4e1-ac97-40d2-ad76-df9b52dbf4f6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:07.833990 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6106c4e1-ac97-40d2-ad76-df9b52dbf4f6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.174809 May 10 16:54:07.834867 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 376/725] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:07 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:08.860930 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-68732f5a-be0e-46f9-aa59-7b5ed3e3b9f7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:08.861621 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-68732f5a-be0e-46f9-aa59-7b5ed3e3b9f7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:08.868123 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-68732f5a-be0e-46f9-aa59-7b5ed3e3b9f7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:08.868600 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-68732f5a-be0e-46f9-aa59-7b5ed3e3b9f7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:08.869360 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-68732f5a-be0e-46f9-aa59-7b5ed3e3b9f7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:08.869790 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-68732f5a-be0e-46f9-aa59-7b5ed3e3b9f7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:08.998980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-68732f5a-be0e-46f9-aa59-7b5ed3e3b9f7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:09.006914 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-68732f5a-be0e-46f9-aa59-7b5ed3e3b9f7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:09.008734 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-68732f5a-be0e-46f9-aa59-7b5ed3e3b9f7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:09.010175 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-68732f5a-be0e-46f9-aa59-7b5ed3e3b9f7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.154271 May 10 16:54:09.010776 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 350/726] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:08 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:10.028566 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2d5dd5b0-2cb8-4185-8f99-0fea286622cb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:10.029292 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2d5dd5b0-2cb8-4185-8f99-0fea286622cb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:10.035818 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2d5dd5b0-2cb8-4185-8f99-0fea286622cb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:10.036264 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2d5dd5b0-2cb8-4185-8f99-0fea286622cb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:10.037055 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2d5dd5b0-2cb8-4185-8f99-0fea286622cb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:10.037488 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2d5dd5b0-2cb8-4185-8f99-0fea286622cb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:10.171471 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2d5dd5b0-2cb8-4185-8f99-0fea286622cb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:10.179558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2d5dd5b0-2cb8-4185-8f99-0fea286622cb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:10.181104 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2d5dd5b0-2cb8-4185-8f99-0fea286622cb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:10.182243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2d5dd5b0-2cb8-4185-8f99-0fea286622cb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.157593 May 10 16:54:10.182805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 377/727] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:10 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:11.201241 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5967fbf2-53fd-4f58-ac17-ab8c0225f307 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:11.201862 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5967fbf2-53fd-4f58-ac17-ab8c0225f307 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:11.208435 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5967fbf2-53fd-4f58-ac17-ab8c0225f307 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:11.208895 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5967fbf2-53fd-4f58-ac17-ab8c0225f307 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:11.209673 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5967fbf2-53fd-4f58-ac17-ab8c0225f307 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:11.210117 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5967fbf2-53fd-4f58-ac17-ab8c0225f307 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:11.343680 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-5967fbf2-53fd-4f58-ac17-ab8c0225f307 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:11.351632 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-5967fbf2-53fd-4f58-ac17-ab8c0225f307 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:11.353265 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-5967fbf2-53fd-4f58-ac17-ab8c0225f307 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:11.354507 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-5967fbf2-53fd-4f58-ac17-ab8c0225f307 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.157670 May 10 16:54:11.355137 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 351/728] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:11 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:12.374359 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-13a6ec2f-20cc-49dd-a40a-af6451211f89 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:12.374962 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-13a6ec2f-20cc-49dd-a40a-af6451211f89 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:12.381398 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-13a6ec2f-20cc-49dd-a40a-af6451211f89 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:12.381853 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-13a6ec2f-20cc-49dd-a40a-af6451211f89 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:12.382626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-13a6ec2f-20cc-49dd-a40a-af6451211f89 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:12.383062 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-13a6ec2f-20cc-49dd-a40a-af6451211f89 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:12.517036 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-13a6ec2f-20cc-49dd-a40a-af6451211f89 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:12.525138 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-13a6ec2f-20cc-49dd-a40a-af6451211f89 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:12.526660 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-13a6ec2f-20cc-49dd-a40a-af6451211f89 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:12.527823 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-13a6ec2f-20cc-49dd-a40a-af6451211f89 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.158001 May 10 16:54:12.528426 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 378/729] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:12 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:13.547865 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f5fad942-2ac1-4dec-8b13-3d9c7ac32c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:13.548521 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f5fad942-2ac1-4dec-8b13-3d9c7ac32c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:13.556983 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5fad942-2ac1-4dec-8b13-3d9c7ac32c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:13.557444 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5fad942-2ac1-4dec-8b13-3d9c7ac32c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:13.558223 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5fad942-2ac1-4dec-8b13-3d9c7ac32c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:13.558847 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5fad942-2ac1-4dec-8b13-3d9c7ac32c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:13.692427 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f5fad942-2ac1-4dec-8b13-3d9c7ac32c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:13.700468 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f5fad942-2ac1-4dec-8b13-3d9c7ac32c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:13.703140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f5fad942-2ac1-4dec-8b13-3d9c7ac32c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:13.704453 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f5fad942-2ac1-4dec-8b13-3d9c7ac32c2d tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1744 microversion: 2.20 time: 0.161194 May 10 16:54:13.705019 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 352/730] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:13 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:14.433385 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-02a439a2-2597-4559-bdd2-396287d54adf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:14.435737 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-02a439a2-2597-4559-bdd2-396287d54adf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:14.440902 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02a439a2-2597-4559-bdd2-396287d54adf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:14.441358 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02a439a2-2597-4559-bdd2-396287d54adf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:14.443227 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02a439a2-2597-4559-bdd2-396287d54adf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:14.443664 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02a439a2-2597-4559-bdd2-396287d54adf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:14.474789 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-02a439a2-2597-4559-bdd2-396287d54adf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045312 May 10 16:54:14.475360 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 379/731] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:54:14 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:54:14.617540 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2952ed34-81a9-422e-b8b4-6704e96c770c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:14.618400 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2952ed34-81a9-422e-b8b4-6704e96c770c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:14.624962 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2952ed34-81a9-422e-b8b4-6704e96c770c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:14.625525 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2952ed34-81a9-422e-b8b4-6704e96c770c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:14.626193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2952ed34-81a9-422e-b8b4-6704e96c770c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:14.626639 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2952ed34-81a9-422e-b8b4-6704e96c770c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:14.664938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2952ed34-81a9-422e-b8b4-6704e96c770c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments/4cccb453-1fb5-42de-ac50-109d6c935f04" status: 200 len: 194 microversion: 2.1 time: 0.050750 May 10 16:54:14.665329 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 353/732] 10.222.0.48 () {58 vars in 1412 bytes} [Tue May 10 16:54:14 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments/4cccb453-1fb5-42de-ac50-109d6c935f04 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:54:14.676492 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-51f13ac4-2a0a-4986-b703-18499e097abf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:14.677070 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-51f13ac4-2a0a-4986-b703-18499e097abf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:14.683713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51f13ac4-2a0a-4986-b703-18499e097abf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:14.684170 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51f13ac4-2a0a-4986-b703-18499e097abf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:14.685410 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51f13ac4-2a0a-4986-b703-18499e097abf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:14.685854 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51f13ac4-2a0a-4986-b703-18499e097abf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:14.725016 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ec16110e-db63-4f5b-a6e6-b069bc6bd1a0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:14.725771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ec16110e-db63-4f5b-a6e6-b069bc6bd1a0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:14.732371 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ec16110e-db63-4f5b-a6e6-b069bc6bd1a0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:14.737936 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ec16110e-db63-4f5b-a6e6-b069bc6bd1a0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:14.737936 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ec16110e-db63-4f5b-a6e6-b069bc6bd1a0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:14.737936 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ec16110e-db63-4f5b-a6e6-b069bc6bd1a0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:14.784624 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-51f13ac4-2a0a-4986-b703-18499e097abf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lazy-loading 'services' on Instance uuid 5a006de3-8903-42e7-bd9c-922e5c314761 {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:54:14.865130 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-51f13ac4-2a0a-4986-b703-18499e097abf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments/4cccb453-1fb5-42de-ac50-109d6c935f04" status: 202 len: 0 microversion: 2.1 time: 0.193913 May 10 16:54:14.865918 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 380/733] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:54:14 2022] DELETE /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments/4cccb453-1fb5-42de-ac50-109d6c935f04 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:54:14.890258 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ec16110e-db63-4f5b-a6e6-b069bc6bd1a0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:14.902113 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ec16110e-db63-4f5b-a6e6-b069bc6bd1a0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:14.904647 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ec16110e-db63-4f5b-a6e6-b069bc6bd1a0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:14.906777 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ec16110e-db63-4f5b-a6e6-b069bc6bd1a0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1744 microversion: 2.20 time: 0.186867 May 10 16:54:14.907479 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 354/734] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:14 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:54:15.926765 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5535ffe2-a239-400a-b9c7-2672bd09ec49 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:15.928292 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-5535ffe2-a239-400a-b9c7-2672bd09ec49 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:15.936701 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5535ffe2-a239-400a-b9c7-2672bd09ec49 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:15.937437 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5535ffe2-a239-400a-b9c7-2672bd09ec49 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:15.946680 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5535ffe2-a239-400a-b9c7-2672bd09ec49 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:15.947515 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5535ffe2-a239-400a-b9c7-2672bd09ec49 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:16.024311 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f7608365-f451-4021-aa34-acc9d8a696b3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:16.024901 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f7608365-f451-4021-aa34-acc9d8a696b3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:16.032927 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f7608365-f451-4021-aa34-acc9d8a696b3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:16.033559 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f7608365-f451-4021-aa34-acc9d8a696b3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:16.035164 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f7608365-f451-4021-aa34-acc9d8a696b3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:16.035164 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f7608365-f451-4021-aa34-acc9d8a696b3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:16.066356 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f7608365-f451-4021-aa34-acc9d8a696b3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments/ac7f6585-dac3-4fd7-a1e4-b1d0998e9c22" status: 200 len: 194 microversion: 2.1 time: 0.047307 May 10 16:54:16.066968 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 355/735] 10.222.0.48 () {58 vars in 1412 bytes} [Tue May 10 16:54:16 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments/ac7f6585-dac3-4fd7-a1e4-b1d0998e9c22 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:54:16.078506 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-69b8a5c6-60f9-4bea-9cc4-416d47bcb35b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:16.079216 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-69b8a5c6-60f9-4bea-9cc4-416d47bcb35b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:16.085708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-69b8a5c6-60f9-4bea-9cc4-416d47bcb35b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:16.086179 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-69b8a5c6-60f9-4bea-9cc4-416d47bcb35b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:16.086966 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-69b8a5c6-60f9-4bea-9cc4-416d47bcb35b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:16.087404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-69b8a5c6-60f9-4bea-9cc4-416d47bcb35b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:16.108678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5535ffe2-a239-400a-b9c7-2672bd09ec49 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:16.116810 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5535ffe2-a239-400a-b9c7-2672bd09ec49 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:16.118803 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5535ffe2-a239-400a-b9c7-2672bd09ec49 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:16.119990 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5535ffe2-a239-400a-b9c7-2672bd09ec49 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1739 microversion: 2.20 time: 0.198106 May 10 16:54:16.120725 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 381/736] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:15 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:54:16.177016 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-69b8a5c6-60f9-4bea-9cc4-416d47bcb35b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lazy-loading 'services' on Instance uuid 5a006de3-8903-42e7-bd9c-922e5c314761 {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:54:16.268417 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-69b8a5c6-60f9-4bea-9cc4-416d47bcb35b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments/ac7f6585-dac3-4fd7-a1e4-b1d0998e9c22" status: 202 len: 0 microversion: 2.1 time: 0.194529 May 10 16:54:16.278315 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 356/737] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:54:16 2022] DELETE /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments/ac7f6585-dac3-4fd7-a1e4-b1d0998e9c22 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:54:17.139025 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3f20481d-539a-4f37-b73b-babef6c923df tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:17.140344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3f20481d-539a-4f37-b73b-babef6c923df tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:17.147351 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3f20481d-539a-4f37-b73b-babef6c923df tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:17.147830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3f20481d-539a-4f37-b73b-babef6c923df tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:17.148628 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3f20481d-539a-4f37-b73b-babef6c923df tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:17.149064 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3f20481d-539a-4f37-b73b-babef6c923df tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:17.312761 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3f20481d-539a-4f37-b73b-babef6c923df tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:17.320944 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3f20481d-539a-4f37-b73b-babef6c923df tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:17.326926 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3f20481d-539a-4f37-b73b-babef6c923df tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:17.328161 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3f20481d-539a-4f37-b73b-babef6c923df tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1739 microversion: 2.20 time: 0.193320 May 10 16:54:17.328813 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 382/738] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:17 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:17.470944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-375c7f05-5ab9-4920-921b-6419d134f593 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:17.472175 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-375c7f05-5ab9-4920-921b-6419d134f593 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:17.480149 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-375c7f05-5ab9-4920-921b-6419d134f593 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:17.480721 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-375c7f05-5ab9-4920-921b-6419d134f593 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:17.482288 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-375c7f05-5ab9-4920-921b-6419d134f593 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:17.482961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-375c7f05-5ab9-4920-921b-6419d134f593 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:17.519761 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-375c7f05-5ab9-4920-921b-6419d134f593 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053631 May 10 16:54:17.520309 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 357/739] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:54:17 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:54:17.649234 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1a83a058-c1f1-47ce-903c-feb4d9ee27fe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:17.650170 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1a83a058-c1f1-47ce-903c-feb4d9ee27fe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:17.657433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1a83a058-c1f1-47ce-903c-feb4d9ee27fe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:17.659455 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1a83a058-c1f1-47ce-903c-feb4d9ee27fe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:17.660256 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1a83a058-c1f1-47ce-903c-feb4d9ee27fe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:17.660899 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1a83a058-c1f1-47ce-903c-feb4d9ee27fe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:17.698565 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1a83a058-c1f1-47ce-903c-feb4d9ee27fe tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053570 May 10 16:54:17.704781 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 383/740] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:54:17 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:54:17.769151 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-1ea9eb32-69f9-411c-bc43-2f124bc1308b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:17.769645 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-1ea9eb32-69f9-411c-bc43-2f124bc1308b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:17.776305 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1ea9eb32-69f9-411c-bc43-2f124bc1308b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:17.776690 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1ea9eb32-69f9-411c-bc43-2f124bc1308b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:17.777479 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1ea9eb32-69f9-411c-bc43-2f124bc1308b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:17.777916 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1ea9eb32-69f9-411c-bc43-2f124bc1308b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:17.806837 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-1ea9eb32-69f9-411c-bc43-2f124bc1308b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:54:17.921919 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-1ea9eb32-69f9-411c-bc43-2f124bc1308b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 204 len: 0 microversion: 2.1 time: 0.156263 May 10 16:54:17.922696 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 358/741] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:54:17 2022] DELETE /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:54:17.934532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6a3d7c5f-3a24-4f23-b5aa-20599a5d4f01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:17.935824 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6a3d7c5f-3a24-4f23-b5aa-20599a5d4f01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:17.942062 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a3d7c5f-3a24-4f23-b5aa-20599a5d4f01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:17.942544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a3d7c5f-3a24-4f23-b5aa-20599a5d4f01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:17.943438 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a3d7c5f-3a24-4f23-b5aa-20599a5d4f01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:17.943901 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6a3d7c5f-3a24-4f23-b5aa-20599a5d4f01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:18.102099 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6a3d7c5f-3a24-4f23-b5aa-20599a5d4f01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:18.110294 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6a3d7c5f-3a24-4f23-b5aa-20599a5d4f01 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1675 microversion: 2.1 time: 0.180706 May 10 16:54:18.111081 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 384/742] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:17 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:18.347184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d557fd2b-bda9-4673-a69d-04dc0527bf35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:18.347961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d557fd2b-bda9-4673-a69d-04dc0527bf35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:18.357773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d557fd2b-bda9-4673-a69d-04dc0527bf35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:18.361256 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d557fd2b-bda9-4673-a69d-04dc0527bf35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:18.362645 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d557fd2b-bda9-4673-a69d-04dc0527bf35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:18.373370 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d557fd2b-bda9-4673-a69d-04dc0527bf35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:18.635148 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d557fd2b-bda9-4673-a69d-04dc0527bf35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:18.645486 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d557fd2b-bda9-4673-a69d-04dc0527bf35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:18.648088 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d557fd2b-bda9-4673-a69d-04dc0527bf35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:18.649859 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d557fd2b-bda9-4673-a69d-04dc0527bf35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1739 microversion: 2.20 time: 0.306762 May 10 16:54:18.650776 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 359/743] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:18 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:18.697999 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-8583cb27-dcb2-4bdd-b4b3-547d3aa82789 req-a25cb558-ae73-49a7-a386-ee29365a6e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c65f78-2474-4331-ad66-738a8ac2162c", "name": "network-vif-plugged", "status": "completed", "tag": "b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:18.710905 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-8583cb27-dcb2-4bdd-b4b3-547d3aa82789 req-a25cb558-ae73-49a7-a386-ee29365a6e92 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:18.711978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-8583cb27-dcb2-4bdd-b4b3-547d3aa82789 req-a25cb558-ae73-49a7-a386-ee29365a6e92 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:18.730006 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-8583cb27-dcb2-4bdd-b4b3-547d3aa82789 req-a25cb558-ae73-49a7-a386-ee29365a6e92 service nova] Creating event network-vif-plugged:b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b for instance a8c65f78-2474-4331-ad66-738a8ac2162c on hv-cinder-83588 May 10 16:54:18.738281 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-8583cb27-dcb2-4bdd-b4b3-547d3aa82789 req-a25cb558-ae73-49a7-a386-ee29365a6e92 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314451 May 10 16:54:18.741998 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 385/744] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:54:19.138493 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-522cd38b-ed28-41e7-b787-3191ca6c5837 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:19.139195 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-522cd38b-ed28-41e7-b787-3191ca6c5837 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:19.147781 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-522cd38b-ed28-41e7-b787-3191ca6c5837 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:19.148341 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-522cd38b-ed28-41e7-b787-3191ca6c5837 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:19.152491 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-522cd38b-ed28-41e7-b787-3191ca6c5837 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:19.153291 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-522cd38b-ed28-41e7-b787-3191ca6c5837 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:19.342759 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-522cd38b-ed28-41e7-b787-3191ca6c5837 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:19.354112 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-522cd38b-ed28-41e7-b787-3191ca6c5837 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1675 microversion: 2.1 time: 0.224160 May 10 16:54:19.354929 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 360/745] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:19 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1675 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:54:19.669734 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3ed09834-e233-4119-be97-e3cb8434f98b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:19.670449 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3ed09834-e233-4119-be97-e3cb8434f98b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:19.683947 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3ed09834-e233-4119-be97-e3cb8434f98b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:19.685390 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3ed09834-e233-4119-be97-e3cb8434f98b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:19.686442 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3ed09834-e233-4119-be97-e3cb8434f98b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:19.687213 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3ed09834-e233-4119-be97-e3cb8434f98b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:20.003438 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3ed09834-e233-4119-be97-e3cb8434f98b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:20.017532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3ed09834-e233-4119-be97-e3cb8434f98b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:20.019377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3ed09834-e233-4119-be97-e3cb8434f98b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:20.021217 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3ed09834-e233-4119-be97-e3cb8434f98b tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1739 microversion: 2.20 time: 0.356224 May 10 16:54:20.026338 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 386/746] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:19 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:20.374455 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-30786875-e2d7-48a5-8818-6123633660c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:20.375184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-30786875-e2d7-48a5-8818-6123633660c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:20.392563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30786875-e2d7-48a5-8818-6123633660c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:20.393228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30786875-e2d7-48a5-8818-6123633660c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:20.394868 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30786875-e2d7-48a5-8818-6123633660c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:20.395425 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30786875-e2d7-48a5-8818-6123633660c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:20.503574 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-30786875-e2d7-48a5-8818-6123633660c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:20.514580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-30786875-e2d7-48a5-8818-6123633660c3 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1607 microversion: 2.1 time: 0.144132 May 10 16:54:20.524849 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 361/747] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:20 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1607 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:20.939056 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-e88385db-6d87-43b6-b8cc-f53a840e8f55 req-df6cddd5-8ad4-435e-978a-5a53d9da6280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a006de3-8903-42e7-bd9c-922e5c314761", "name": "network-vif-deleted", "tag": "fbedc143-bd9d-4787-99d5-b8ca349557d4"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:20.956254 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-e88385db-6d87-43b6-b8cc-f53a840e8f55 req-df6cddd5-8ad4-435e-978a-5a53d9da6280 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:20.974123 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-e88385db-6d87-43b6-b8cc-f53a840e8f55 req-df6cddd5-8ad4-435e-978a-5a53d9da6280 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:21.001217 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-e88385db-6d87-43b6-b8cc-f53a840e8f55 req-df6cddd5-8ad4-435e-978a-5a53d9da6280 service nova] Creating event network-vif-deleted:fbedc143-bd9d-4787-99d5-b8ca349557d4 for instance 5a006de3-8903-42e7-bd9c-922e5c314761 on hv-cinder-83588 May 10 16:54:21.007755 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-e88385db-6d87-43b6-b8cc-f53a840e8f55 req-df6cddd5-8ad4-435e-978a-5a53d9da6280 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077582 May 10 16:54:21.025107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 387/748] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:54:21.045125 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-30471708-98ca-4c3b-b3e1-912b6cd7ea41 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:21.045806 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-30471708-98ca-4c3b-b3e1-912b6cd7ea41 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:21.061870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30471708-98ca-4c3b-b3e1-912b6cd7ea41 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:21.062622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30471708-98ca-4c3b-b3e1-912b6cd7ea41 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:21.063596 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30471708-98ca-4c3b-b3e1-912b6cd7ea41 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:21.064201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-30471708-98ca-4c3b-b3e1-912b6cd7ea41 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:21.325638 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-30471708-98ca-4c3b-b3e1-912b6cd7ea41 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:21.334735 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-30471708-98ca-4c3b-b3e1-912b6cd7ea41 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:21.336256 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-30471708-98ca-4c3b-b3e1-912b6cd7ea41 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:21.337463 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-30471708-98ca-4c3b-b3e1-912b6cd7ea41 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1739 microversion: 2.20 time: 0.297101 May 10 16:54:21.338471 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 362/749] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:21 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:21.549683 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:21.550702 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:21.559041 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:21.560464 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:21.562180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:21.562855 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:21.644366 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:21.645196 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:21.648323 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lazy-loading 'fault' on Instance uuid 5a006de3-8903-42e7-bd9c-922e5c314761 {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:54:21.739075 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2a00f1a578d44abadaa39db5235363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c526b65f8454d7e84b29236f42417f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:21.752131 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a1ac0dbb-ced8-4144-974d-c2724a741c9b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 200 len: 1327 microversion: 2.1 time: 0.224158 May 10 16:54:21.753333 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 388/750] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:21 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 1327 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:22.358316 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a8a2b672-f165-4792-a226-c2ba07d55ba1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:22.359771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a8a2b672-f165-4792-a226-c2ba07d55ba1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:22.367886 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a8a2b672-f165-4792-a226-c2ba07d55ba1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:22.369028 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a8a2b672-f165-4792-a226-c2ba07d55ba1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:22.370052 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a8a2b672-f165-4792-a226-c2ba07d55ba1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:22.370596 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a8a2b672-f165-4792-a226-c2ba07d55ba1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:22.559362 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a8a2b672-f165-4792-a226-c2ba07d55ba1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:22.571307 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a8a2b672-f165-4792-a226-c2ba07d55ba1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:22.580203 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a8a2b672-f165-4792-a226-c2ba07d55ba1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:22.581662 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a8a2b672-f165-4792-a226-c2ba07d55ba1 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1739 microversion: 2.20 time: 0.227845 May 10 16:54:22.592203 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 363/751] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:22 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:22.778486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-90c56270-298b-4baf-ac63-dad4ec8ada54 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:22.780112 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-90c56270-298b-4baf-ac63-dad4ec8ada54 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:22.786869 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-90c56270-298b-4baf-ac63-dad4ec8ada54 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:22.787321 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-90c56270-298b-4baf-ac63-dad4ec8ada54 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:22.788099 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-90c56270-298b-4baf-ac63-dad4ec8ada54 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:22.788574 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-90c56270-298b-4baf-ac63-dad4ec8ada54 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:22.804081 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-90c56270-298b-4baf-ac63-dad4ec8ada54 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] HTTP exception thrown: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-90c56270-298b-4baf-ac63-dad4ec8ada54 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Request method failure captured: May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 HTTP/1.1 May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdQUWME-M42T6ap2wvSA72LK3d_8fYYKg-JbDtSEnqXrr9wRvjRj-AERPVrC38IdC0ML7XTjQp2fDBjckEn3WZudtx7Mt-kskWqVr8rRVM5UDB3x4FYg_H-qxfut0TYZ82aAmVtldXdH0PSUolsqoATMo9yZ-4jrKtkkoxp5oiWD1c May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:54:22.805768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: e2a00f1a578d44abadaa39db5235363a May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:22.807152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '5a006de3-8903-42e7-bd9c-922e5c314761'} May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:54:22.812924 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:22.814221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:22.815336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-90c56270-298b-4baf-ac63-dad4ec8ada54 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Returning 404 to user: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:54:22.815336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-90c56270-298b-4baf-ac63-dad4ec8ada54 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 404 len: 111 microversion: 2.1 time: 0.033285 May 10 16:54:22.815336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 389/752] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:22 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:54:22.817324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cbe045c6-2eee-4697-b027-16f7ecdfdd16 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '.version_select at 0x7f5fb6abee50>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:22.842655 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cbe045c6-2eee-4697-b027-16f7ecdfdd16 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-637518848" status: 202 len: 0 microversion: 2.1 time: 0.029046 May 10 16:54:22.846795 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 364/753] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 10 16:54:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-637518848 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:54:23.621548 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f7e65c7f-e2c8-4ffe-bc53-8eff4fbe94a6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:23.623292 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f7e65c7f-e2c8-4ffe-bc53-8eff4fbe94a6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:23.632564 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f7e65c7f-e2c8-4ffe-bc53-8eff4fbe94a6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:23.634292 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f7e65c7f-e2c8-4ffe-bc53-8eff4fbe94a6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:23.634292 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f7e65c7f-e2c8-4ffe-bc53-8eff4fbe94a6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:23.635031 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f7e65c7f-e2c8-4ffe-bc53-8eff4fbe94a6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:23.844859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f7e65c7f-e2c8-4ffe-bc53-8eff4fbe94a6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:23.853472 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f7e65c7f-e2c8-4ffe-bc53-8eff4fbe94a6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:23.854986 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f7e65c7f-e2c8-4ffe-bc53-8eff4fbe94a6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:23.856188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f7e65c7f-e2c8-4ffe-bc53-8eff4fbe94a6 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1739 microversion: 2.20 time: 0.239797 May 10 16:54:23.856939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 390/754] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:23 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:24.877827 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a9cab09e-00af-4184-a442-62691ccebbbf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:24.880062 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a9cab09e-00af-4184-a442-62691ccebbbf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:24.896688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9cab09e-00af-4184-a442-62691ccebbbf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:24.897147 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9cab09e-00af-4184-a442-62691ccebbbf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:24.897932 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9cab09e-00af-4184-a442-62691ccebbbf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:24.898374 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9cab09e-00af-4184-a442-62691ccebbbf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:25.063744 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a9cab09e-00af-4184-a442-62691ccebbbf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:25.074094 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a9cab09e-00af-4184-a442-62691ccebbbf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:25.076579 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a9cab09e-00af-4184-a442-62691ccebbbf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:25.077970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a9cab09e-00af-4184-a442-62691ccebbbf tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1739 microversion: 2.20 time: 0.206910 May 10 16:54:25.078556 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 365/755] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:24 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:26.001491 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1e6d5d7d-853c-46a4-ae51-59892230489b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:26.002755 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1e6d5d7d-853c-46a4-ae51-59892230489b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:26.010148 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1e6d5d7d-853c-46a4-ae51-59892230489b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:26.010993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1e6d5d7d-853c-46a4-ae51-59892230489b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:26.011988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1e6d5d7d-853c-46a4-ae51-59892230489b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:26.013352 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1e6d5d7d-853c-46a4-ae51-59892230489b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:26.029343 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-1e6d5d7d-853c-46a4-ae51-59892230489b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] HTTP exception thrown: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1e6d5d7d-853c-46a4-ae51-59892230489b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Request method failure captured: May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: DELETE /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 HTTP/1.1 May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdQUWME-M42T6ap2wvSA72LK3d_8fYYKg-JbDtSEnqXrr9wRvjRj-AERPVrC38IdC0ML7XTjQp2fDBjckEn3WZudtx7Mt-kskWqVr8rRVM5UDB3x4FYg_H-qxfut0TYZ82aAmVtldXdH0PSUolsqoATMo9yZ-4jrKtkkoxp5oiWD1c May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:54:26.031200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: e2a00f1a578d44abadaa39db5235363a May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:26.032726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '5a006de3-8903-42e7-bd9c-922e5c314761'} May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:54:26.033771 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:26.035252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:26.036751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1e6d5d7d-853c-46a4-ae51-59892230489b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Returning 404 to user: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:54:26.036751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1e6d5d7d-853c-46a4-ae51-59892230489b tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 404 len: 111 microversion: 2.1 time: 0.035421 May 10 16:54:26.036751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 391/756] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:54:25 2022] DELETE /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:54:26.045004 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7457e021-08dd-427c-9299-daa9082a77bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:26.045632 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7457e021-08dd-427c-9299-daa9082a77bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: 5a006de3-8903-42e7-bd9c-922e5c314761] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:26.052247 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7457e021-08dd-427c-9299-daa9082a77bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:26.052814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7457e021-08dd-427c-9299-daa9082a77bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:26.053604 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7457e021-08dd-427c-9299-daa9082a77bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:26.054045 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7457e021-08dd-427c-9299-daa9082a77bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:26.070490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-7457e021-08dd-427c-9299-daa9082a77bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] HTTP exception thrown: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7457e021-08dd-427c-9299-daa9082a77bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Request method failure captured: May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 HTTP/1.1 May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepdQUWME-M42T6ap2wvSA72LK3d_8fYYKg-JbDtSEnqXrr9wRvjRj-AERPVrC38IdC0ML7XTjQp2fDBjckEn3WZudtx7Mt-kskWqVr8rRVM5UDB3x4FYg_H-qxfut0TYZ82aAmVtldXdH0PSUolsqoATMo9yZ-4jrKtkkoxp5oiWD1c May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:54:26.073473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: e2a00f1a578d44abadaa39db5235363a May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:26.075562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '5a006de3-8903-42e7-bd9c-922e5c314761'} May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:54:26.076791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. May 10 16:54:26.078546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:54:26.080873 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7457e021-08dd-427c-9299-daa9082a77bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Returning 404 to user: Instance 5a006de3-8903-42e7-bd9c-922e5c314761 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:54:26.080873 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7457e021-08dd-427c-9299-daa9082a77bf tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761" status: 404 len: 111 microversion: 2.1 time: 0.038752 May 10 16:54:26.082022 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 366/757] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:26 2022] GET /compute/v2.1/servers/5a006de3-8903-42e7-bd9c-922e5c314761 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:54:26.100185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-cdc8c612-90ae-46c1-a306-afe0ba0be39e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:26.100185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-cdc8c612-90ae-46c1-a306-afe0ba0be39e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:26.104643 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cdc8c612-90ae-46c1-a306-afe0ba0be39e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:26.105169 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cdc8c612-90ae-46c1-a306-afe0ba0be39e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:26.105888 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cdc8c612-90ae-46c1-a306-afe0ba0be39e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:26.106425 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cdc8c612-90ae-46c1-a306-afe0ba0be39e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:26.267179 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cdc8c612-90ae-46c1-a306-afe0ba0be39e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:26.275006 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cdc8c612-90ae-46c1-a306-afe0ba0be39e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:26.276602 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cdc8c612-90ae-46c1-a306-afe0ba0be39e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:26.277830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-cdc8c612-90ae-46c1-a306-afe0ba0be39e tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1739 microversion: 2.20 time: 0.184200 May 10 16:54:26.278590 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 392/758] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:26 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:27.230103 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-12829e77-cf3f-489a-b58c-8870a8b4745c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:27.230637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-12829e77-cf3f-489a-b58c-8870a8b4745c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:27.237456 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-12829e77-cf3f-489a-b58c-8870a8b4745c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:27.237909 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-12829e77-cf3f-489a-b58c-8870a8b4745c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:27.238684 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-12829e77-cf3f-489a-b58c-8870a8b4745c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:27.239118 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-12829e77-cf3f-489a-b58c-8870a8b4745c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:27.253003 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-12829e77-cf3f-489a-b58c-8870a8b4745c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] HTTP exception thrown: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-12829e77-cf3f-489a-b58c-8870a8b4745c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Request method failure captured: May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: DELETE /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 HTTP/1.1 May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepdQUWME-M42T6ap2wvSA72LK3d_8fYYKg-JbDtSEnqXrr9wRvjRj-AERPVrC38IdC0ML7XTjQp2fDBjckEn3WZudtx7Mt-kskWqVr8rRVM5UDB3x4FYg_H-qxfut0TYZ82aAmVtldXdH0PSUolsqoATMo9yZ-4jrKtkkoxp5oiWD1c May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:54:27.254746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: e2a00f1a578d44abadaa39db5235363a May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:54:27.256541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': 'a2b9076f-b216-4383-b9fd-80b05ada72a8'} May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:54:27.257373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:54:27.258938 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:54:27.260602 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-12829e77-cf3f-489a-b58c-8870a8b4745c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Returning 404 to user: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:54:27.260602 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-12829e77-cf3f-489a-b58c-8870a8b4745c tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 404 len: 111 microversion: 2.1 time: 0.029881 May 10 16:54:27.260602 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 367/759] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:54:27 2022] DELETE /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:54:27.265648 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7c9c6828-2819-4ece-a478-c35f89e66a10 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:27.266266 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7c9c6828-2819-4ece-a478-c35f89e66a10 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] [instance: a2b9076f-b216-4383-b9fd-80b05ada72a8] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:27.273471 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7c9c6828-2819-4ece-a478-c35f89e66a10 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:27.273955 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7c9c6828-2819-4ece-a478-c35f89e66a10 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:27.274727 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7c9c6828-2819-4ece-a478-c35f89e66a10 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:27.275195 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7c9c6828-2819-4ece-a478-c35f89e66a10 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:27.289501 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-7c9c6828-2819-4ece-a478-c35f89e66a10 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] HTTP exception thrown: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7c9c6828-2819-4ece-a478-c35f89e66a10 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Request method failure captured: May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 HTTP/1.1 May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdQUWME-M42T6ap2wvSA72LK3d_8fYYKg-JbDtSEnqXrr9wRvjRj-AERPVrC38IdC0ML7XTjQp2fDBjckEn3WZudtx7Mt-kskWqVr8rRVM5UDB3x4FYg_H-qxfut0TYZ82aAmVtldXdH0PSUolsqoATMo9yZ-4jrKtkkoxp5oiWD1c May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:54:27.290976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c526b65f8454d7e84b29236f42417f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 6c526b65f8454d7e84b29236f42417f7 May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1128424456 May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: e2a00f1a578d44abadaa39db5235363a May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeTestJSON-1128424456-project May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:54:27.292521 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'a2b9076f-b216-4383-b9fd-80b05ada72a8'} May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:54:27.293370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. May 10 16:54:27.294836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:54:27.296085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7c9c6828-2819-4ece-a478-c35f89e66a10 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] Returning 404 to user: Instance a2b9076f-b216-4383-b9fd-80b05ada72a8 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:54:27.296085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7c9c6828-2819-4ece-a478-c35f89e66a10 tempest-AttachVolumeTestJSON-1128424456 tempest-AttachVolumeTestJSON-1128424456-project] 10.222.0.48 "GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8" status: 404 len: 111 microversion: 2.1 time: 0.034077 May 10 16:54:27.296085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 393/760] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:27 2022] GET /compute/v2.1/servers/a2b9076f-b216-4383-b9fd-80b05ada72a8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:54:27.296579 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-27e90efd-0968-434f-9c53-4a531ac410f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:27.297198 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-27e90efd-0968-434f-9c53-4a531ac410f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:27.303583 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-27e90efd-0968-434f-9c53-4a531ac410f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:27.304026 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-27e90efd-0968-434f-9c53-4a531ac410f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:27.304948 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-27e90efd-0968-434f-9c53-4a531ac410f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:27.305387 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-27e90efd-0968-434f-9c53-4a531ac410f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:27.445122 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-27e90efd-0968-434f-9c53-4a531ac410f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:27.453631 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-27e90efd-0968-434f-9c53-4a531ac410f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:27.455138 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-27e90efd-0968-434f-9c53-4a531ac410f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:27.456314 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-27e90efd-0968-434f-9c53-4a531ac410f5 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1721 microversion: 2.20 time: 0.164322 May 10 16:54:27.457035 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 368/761] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:27 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:54:28.476259 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b3a09430-42a6-489c-99f4-921b5056e8d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:28.477484 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b3a09430-42a6-489c-99f4-921b5056e8d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:28.483826 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3a09430-42a6-489c-99f4-921b5056e8d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:28.484299 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3a09430-42a6-489c-99f4-921b5056e8d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:28.485864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3a09430-42a6-489c-99f4-921b5056e8d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:28.486626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b3a09430-42a6-489c-99f4-921b5056e8d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:28.642319 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b3a09430-42a6-489c-99f4-921b5056e8d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:28.650300 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b3a09430-42a6-489c-99f4-921b5056e8d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:28.651850 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-b3a09430-42a6-489c-99f4-921b5056e8d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:28.653632 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b3a09430-42a6-489c-99f4-921b5056e8d0 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1721 microversion: 2.20 time: 0.180940 May 10 16:54:28.654195 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 394/762] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:28 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:29.671792 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7d3062a1-2557-4611-b151-9f5ac31ce2a3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:29.672472 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7d3062a1-2557-4611-b151-9f5ac31ce2a3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:29.680975 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7d3062a1-2557-4611-b151-9f5ac31ce2a3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:29.681434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7d3062a1-2557-4611-b151-9f5ac31ce2a3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:29.682223 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7d3062a1-2557-4611-b151-9f5ac31ce2a3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:29.684873 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7d3062a1-2557-4611-b151-9f5ac31ce2a3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:29.828406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7d3062a1-2557-4611-b151-9f5ac31ce2a3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:29.837184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7d3062a1-2557-4611-b151-9f5ac31ce2a3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:29.838713 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7d3062a1-2557-4611-b151-9f5ac31ce2a3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:29.839882 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7d3062a1-2557-4611-b151-9f5ac31ce2a3 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1664 microversion: 2.20 time: 0.172925 May 10 16:54:29.841066 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 369/763] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:29 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:29.860444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-541a52b1-1ce8-4e45-9882-f781bc172960 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdff339a-98a9-4c92-ad17-78d6eec2a3e3"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:29.861609 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-541a52b1-1ce8-4e45-9882-f781bc172960 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:29.870054 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-541a52b1-1ce8-4e45-9882-f781bc172960 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:29.870520 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-541a52b1-1ce8-4e45-9882-f781bc172960 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:29.871302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-541a52b1-1ce8-4e45-9882-f781bc172960 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:29.872395 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-541a52b1-1ce8-4e45-9882-f781bc172960 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:30.185480 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-541a52b1-1ce8-4e45-9882-f781bc172960 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "POST /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330810 May 10 16:54:30.187920 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 395/764] 10.222.0.48 () {62 vars in 1363 bytes} [Tue May 10 16:54:29 2022] POST /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:54:30.346356 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0a92cc7e-bd80-4249-b85a-1be79b3aa4d8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:30.347470 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0a92cc7e-bd80-4249-b85a-1be79b3aa4d8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:30.358314 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0a92cc7e-bd80-4249-b85a-1be79b3aa4d8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:30.359239 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0a92cc7e-bd80-4249-b85a-1be79b3aa4d8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:30.360753 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0a92cc7e-bd80-4249-b85a-1be79b3aa4d8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:30.361201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0a92cc7e-bd80-4249-b85a-1be79b3aa4d8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:30.519714 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-8011184b-72af-4b28-abc9-e3ecb366ba33 req-c6a53733-20a6-4913-9657-54696ec704e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c65f78-2474-4331-ad66-738a8ac2162c", "name": "network-vif-unplugged", "status": "completed", "tag": "b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:30.539396 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-8011184b-72af-4b28-abc9-e3ecb366ba33 req-c6a53733-20a6-4913-9657-54696ec704e8 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:30.540444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-8011184b-72af-4b28-abc9-e3ecb366ba33 req-c6a53733-20a6-4913-9657-54696ec704e8 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:30.576441 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.compute.server_external_events [req-8011184b-72af-4b28-abc9-e3ecb366ba33 req-c6a53733-20a6-4913-9657-54696ec704e8 service nova] Unable to find a host for instance a8c65f78-2474-4331-ad66-738a8ac2162c. Dropping event network-vif-unplugged {{(pid=134195) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 16:54:30.577741 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-8011184b-72af-4b28-abc9-e3ecb366ba33 req-c6a53733-20a6-4913-9657-54696ec704e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.062099 May 10 16:54:30.584618 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 396/765] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 16:54:30.818733 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0a92cc7e-bd80-4249-b85a-1be79b3aa4d8 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/os-volume_attachments/fdff339a-98a9-4c92-ad17-78d6eec2a3e3" status: 202 len: 0 microversion: 2.20 time: 0.479067 May 10 16:54:30.829152 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 370/766] 10.222.0.48 () {60 vars in 1456 bytes} [Tue May 10 16:54:30 2022] DELETE /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/os-volume_attachments/fdff339a-98a9-4c92-ad17-78d6eec2a3e3 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 16:54:30.883990 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0719558a-facf-430b-9bab-54804f8cd1cd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:30.885246 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0719558a-facf-430b-9bab-54804f8cd1cd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:30.891177 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0719558a-facf-430b-9bab-54804f8cd1cd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:30.891568 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0719558a-facf-430b-9bab-54804f8cd1cd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:30.892416 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0719558a-facf-430b-9bab-54804f8cd1cd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:30.892858 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0719558a-facf-430b-9bab-54804f8cd1cd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:31.096594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0719558a-facf-430b-9bab-54804f8cd1cd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "POST /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/action" status: 202 len: 0 microversion: 2.20 time: 0.216301 May 10 16:54:31.097367 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 397/767] 10.222.0.48 () {62 vars in 1318 bytes} [Tue May 10 16:54:30 2022] POST /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 16:54:31.107641 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cf7c4d5c-3133-4b80-991e-25e9775a8cee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:31.108504 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cf7c4d5c-3133-4b80-991e-25e9775a8cee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:31.118411 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf7c4d5c-3133-4b80-991e-25e9775a8cee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:31.118871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf7c4d5c-3133-4b80-991e-25e9775a8cee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:31.119661 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf7c4d5c-3133-4b80-991e-25e9775a8cee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:31.120103 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cf7c4d5c-3133-4b80-991e-25e9775a8cee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:31.288398 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cf7c4d5c-3133-4b80-991e-25e9775a8cee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:31.300903 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cf7c4d5c-3133-4b80-991e-25e9775a8cee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:31.304147 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cf7c4d5c-3133-4b80-991e-25e9775a8cee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:31.305765 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cf7c4d5c-3133-4b80-991e-25e9775a8cee tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1672 microversion: 2.20 time: 0.203875 May 10 16:54:31.306476 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 371/768] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:31 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:32.327517 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-aa86f9aa-26ac-493d-8c3a-93b86f8fb478 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:32.328152 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-aa86f9aa-26ac-493d-8c3a-93b86f8fb478 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:32.336662 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa86f9aa-26ac-493d-8c3a-93b86f8fb478 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:32.337536 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa86f9aa-26ac-493d-8c3a-93b86f8fb478 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:32.338559 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa86f9aa-26ac-493d-8c3a-93b86f8fb478 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:32.339701 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-aa86f9aa-26ac-493d-8c3a-93b86f8fb478 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:32.517255 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-aa86f9aa-26ac-493d-8c3a-93b86f8fb478 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:32.525482 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-aa86f9aa-26ac-493d-8c3a-93b86f8fb478 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:32.526995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-aa86f9aa-26ac-493d-8c3a-93b86f8fb478 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:32.528380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-aa86f9aa-26ac-493d-8c3a-93b86f8fb478 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1672 microversion: 2.20 time: 0.206708 May 10 16:54:32.530364 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 398/769] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:32 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1672 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:33.547228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-4561e180-249f-4dd6-9364-a2017b06b5bd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:33.548670 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-4561e180-249f-4dd6-9364-a2017b06b5bd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:33.557053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4561e180-249f-4dd6-9364-a2017b06b5bd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:33.557731 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4561e180-249f-4dd6-9364-a2017b06b5bd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:33.558973 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4561e180-249f-4dd6-9364-a2017b06b5bd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:33.559925 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-4561e180-249f-4dd6-9364-a2017b06b5bd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:33.702419 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4561e180-249f-4dd6-9364-a2017b06b5bd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:33.710504 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4561e180-249f-4dd6-9364-a2017b06b5bd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:33.712009 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-4561e180-249f-4dd6-9364-a2017b06b5bd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:33.713195 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-4561e180-249f-4dd6-9364-a2017b06b5bd tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.170556 May 10 16:54:33.713764 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 372/770] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:33 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:34.733366 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9758cee4-5cdd-462b-9d27-a352c68c35d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:34.734640 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9758cee4-5cdd-462b-9d27-a352c68c35d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:34.753386 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9758cee4-5cdd-462b-9d27-a352c68c35d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:34.754258 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9758cee4-5cdd-462b-9d27-a352c68c35d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:34.755302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9758cee4-5cdd-462b-9d27-a352c68c35d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:34.755934 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9758cee4-5cdd-462b-9d27-a352c68c35d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:35.062172 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9758cee4-5cdd-462b-9d27-a352c68c35d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:35.070566 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9758cee4-5cdd-462b-9d27-a352c68c35d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:35.081346 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9758cee4-5cdd-462b-9d27-a352c68c35d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:35.082820 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9758cee4-5cdd-462b-9d27-a352c68c35d7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.355515 May 10 16:54:35.088794 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 399/771] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:34 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:36.105749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-94f5c16c-93dd-4591-b6b2-f55d72b62a46 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:36.107287 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-94f5c16c-93dd-4591-b6b2-f55d72b62a46 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:36.125281 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-94f5c16c-93dd-4591-b6b2-f55d72b62a46 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:36.126025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-94f5c16c-93dd-4591-b6b2-f55d72b62a46 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:36.127114 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-94f5c16c-93dd-4591-b6b2-f55d72b62a46 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:36.127864 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-94f5c16c-93dd-4591-b6b2-f55d72b62a46 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:36.414152 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-94f5c16c-93dd-4591-b6b2-f55d72b62a46 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:36.440560 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-94f5c16c-93dd-4591-b6b2-f55d72b62a46 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:36.443039 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-94f5c16c-93dd-4591-b6b2-f55d72b62a46 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:36.444539 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-94f5c16c-93dd-4591-b6b2-f55d72b62a46 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.342692 May 10 16:54:36.455436 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 373/772] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:36 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:37.466287 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4f44e441-31cf-4645-b2d8-8df245387499 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:37.467809 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4f44e441-31cf-4645-b2d8-8df245387499 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:37.474566 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4f44e441-31cf-4645-b2d8-8df245387499 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:37.482202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4f44e441-31cf-4645-b2d8-8df245387499 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:37.484604 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4f44e441-31cf-4645-b2d8-8df245387499 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:37.486642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4f44e441-31cf-4645-b2d8-8df245387499 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:37.693185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4f44e441-31cf-4645-b2d8-8df245387499 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:37.706678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4f44e441-31cf-4645-b2d8-8df245387499 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:37.708689 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4f44e441-31cf-4645-b2d8-8df245387499 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:37.710271 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4f44e441-31cf-4645-b2d8-8df245387499 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.249332 May 10 16:54:37.724220 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 400/773] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:37 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:38.735654 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6bd17491-2094-4a02-9b9e-e3208196081a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:38.741057 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6bd17491-2094-4a02-9b9e-e3208196081a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:38.750270 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6bd17491-2094-4a02-9b9e-e3208196081a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:38.750735 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6bd17491-2094-4a02-9b9e-e3208196081a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:38.751544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6bd17491-2094-4a02-9b9e-e3208196081a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:38.751969 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6bd17491-2094-4a02-9b9e-e3208196081a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:38.907818 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ada93b57-3993-47f6-bb37-2199776f39b4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: .version_select at 0x7f5fbfeba310>, body: {"keypair": {"name": "tempest-keypair-387672031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmTkUwLlqr/vVn4sHDj+WpdFCzgT/UsotGy/YQS8tYdkAw28/UFDifZvmjRYz7xtI0it4sW9AHymeknnt9YZQzj4HnB//txgNR3bT5dL911SWIayvmSy5KzfGX8fNsKiA=="}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:38.941423 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-ada93b57-3993-47f6-bb37-2199776f39b4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:54:38.947554 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-ada93b57-3993-47f6-bb37-2199776f39b4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for user 69585611ca7547adb43378445b4f1521 and project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:54:39.001278 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ada93b57-3993-47f6-bb37-2199776f39b4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.235432 May 10 16:54:39.003702 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 401/774] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 10 16:54:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:54:39.037481 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6bd17491-2094-4a02-9b9e-e3208196081a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:39.076375 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6bd17491-2094-4a02-9b9e-e3208196081a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:39.078161 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6bd17491-2094-4a02-9b9e-e3208196081a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:39.080164 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6bd17491-2094-4a02-9b9e-e3208196081a tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.352890 May 10 16:54:39.081026 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 374/775] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:38 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:40.099476 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4bab859f-c654-4d47-9180-2eb65ff4df33 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:40.100329 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4bab859f-c654-4d47-9180-2eb65ff4df33 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:40.115049 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4bab859f-c654-4d47-9180-2eb65ff4df33 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:40.117591 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4bab859f-c654-4d47-9180-2eb65ff4df33 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:40.118901 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4bab859f-c654-4d47-9180-2eb65ff4df33 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:40.119527 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4bab859f-c654-4d47-9180-2eb65ff4df33 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:40.523454 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4bab859f-c654-4d47-9180-2eb65ff4df33 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:40.533856 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4bab859f-c654-4d47-9180-2eb65ff4df33 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:40.535980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4bab859f-c654-4d47-9180-2eb65ff4df33 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:40.538213 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4bab859f-c654-4d47-9180-2eb65ff4df33 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.443184 May 10 16:54:40.539056 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 402/776] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:40 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:54:41.350710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-705686732", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46307fca-4b0a-4fde-a0d0-41f51f1065e5"}], "security_groups": [{"name": "tempest-securitygroup--1760548086"}], "key_name": "tempest-keypair-387672031", "user_data": "}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:41.504215 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] validate_networks() for [('46307fca-4b0a-4fde-a0d0-41f51f1065e5', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:54:41.561561 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-dc8bd21f-2af4-4a7e-ba18-3e1a0e321730 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:41.562171 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-dc8bd21f-2af4-4a7e-ba18-3e1a0e321730 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:41.569067 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc8bd21f-2af4-4a7e-ba18-3e1a0e321730 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:41.575060 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc8bd21f-2af4-4a7e-ba18-3e1a0e321730 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:41.579980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc8bd21f-2af4-4a7e-ba18-3e1a0e321730 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:41.584229 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-dc8bd21f-2af4-4a7e-ba18-3e1a0e321730 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:41.932776 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-dc8bd21f-2af4-4a7e-ba18-3e1a0e321730 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:41.963898 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-dc8bd21f-2af4-4a7e-ba18-3e1a0e321730 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:41.982687 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-dc8bd21f-2af4-4a7e-ba18-3e1a0e321730 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:41.986443 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-dc8bd21f-2af4-4a7e-ba18-3e1a0e321730 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.431687 May 10 16:54:41.991279 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 403/777] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:41 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:42.375882 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:54:42.376364 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:54:42.376798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:54:42.377207 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:54:42.377760 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:54:42.387413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:42.388224 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:42.389403 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:42.390052 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:42.431651 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:54:42.436687 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for user 69585611ca7547adb43378445b4f1521 and project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:54:42.462763 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:54:42.465822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:54:42.540718 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6a8db046-156b-4065-bf7b-f0babb994fbc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.195596 May 10 16:54:42.545624 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 375/778] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:54:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:54:42.576183 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-21f725d8-e17d-45ba-9397-b6837c5be76b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:42.578132 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-21f725d8-e17d-45ba-9397-b6837c5be76b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:42.691610 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-21f725d8-e17d-45ba-9397-b6837c5be76b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:42.700094 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-21f725d8-e17d-45ba-9397-b6837c5be76b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1240 microversion: 2.1 time: 0.148525 May 10 16:54:42.702805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 404/779] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:42 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1240 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:43.009582 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f3042608-dc9e-4300-b7f4-e6bb81a339f4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:43.010191 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f3042608-dc9e-4300-b7f4-e6bb81a339f4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:43.027513 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f3042608-dc9e-4300-b7f4-e6bb81a339f4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:43.029221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f3042608-dc9e-4300-b7f4-e6bb81a339f4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:43.030121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f3042608-dc9e-4300-b7f4-e6bb81a339f4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:43.030781 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f3042608-dc9e-4300-b7f4-e6bb81a339f4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:43.182301 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f3042608-dc9e-4300-b7f4-e6bb81a339f4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:43.190667 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f3042608-dc9e-4300-b7f4-e6bb81a339f4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:43.192176 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f3042608-dc9e-4300-b7f4-e6bb81a339f4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:43.193396 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f3042608-dc9e-4300-b7f4-e6bb81a339f4 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.187745 May 10 16:54:43.193962 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 376/780] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:43 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:43.719546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d34b3ce1-cf9e-4809-bb41-d01eb3422ac3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:43.720183 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d34b3ce1-cf9e-4809-bb41-d01eb3422ac3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:43.729434 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d34b3ce1-cf9e-4809-bb41-d01eb3422ac3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:43.729893 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d34b3ce1-cf9e-4809-bb41-d01eb3422ac3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:43.731174 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d34b3ce1-cf9e-4809-bb41-d01eb3422ac3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:43.732144 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d34b3ce1-cf9e-4809-bb41-d01eb3422ac3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:43.792562 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-d34b3ce1-cf9e-4809-bb41-d01eb3422ac3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:43.800809 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d34b3ce1-cf9e-4809-bb41-d01eb3422ac3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1244 microversion: 2.1 time: 0.085873 May 10 16:54:43.801378 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 405/781] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:43 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:44.211727 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-56f16318-6d6a-45f2-a36e-5b5e416f4954 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:44.212352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-56f16318-6d6a-45f2-a36e-5b5e416f4954 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:44.219306 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56f16318-6d6a-45f2-a36e-5b5e416f4954 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:44.219752 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56f16318-6d6a-45f2-a36e-5b5e416f4954 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:44.220543 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56f16318-6d6a-45f2-a36e-5b5e416f4954 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:44.220977 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56f16318-6d6a-45f2-a36e-5b5e416f4954 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:44.358817 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-56f16318-6d6a-45f2-a36e-5b5e416f4954 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:44.366649 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-56f16318-6d6a-45f2-a36e-5b5e416f4954 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:44.368149 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-56f16318-6d6a-45f2-a36e-5b5e416f4954 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:44.369343 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-56f16318-6d6a-45f2-a36e-5b5e416f4954 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.161523 May 10 16:54:44.369914 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 377/782] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:44 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:44.819264 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-10f10f7c-fcc5-4d7c-b1cd-0ea707968bcc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:44.819866 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-10f10f7c-fcc5-4d7c-b1cd-0ea707968bcc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:44.827230 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-10f10f7c-fcc5-4d7c-b1cd-0ea707968bcc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:44.827847 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-10f10f7c-fcc5-4d7c-b1cd-0ea707968bcc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:44.828768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-10f10f7c-fcc5-4d7c-b1cd-0ea707968bcc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:44.829243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-10f10f7c-fcc5-4d7c-b1cd-0ea707968bcc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:44.932099 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-10f10f7c-fcc5-4d7c-b1cd-0ea707968bcc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:44.941334 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-10f10f7c-fcc5-4d7c-b1cd-0ea707968bcc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1298 microversion: 2.1 time: 0.126805 May 10 16:54:44.941922 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 406/783] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:44 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:45.387820 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6126c303-03c2-4092-a3c9-3013d518bfe7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:45.388561 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6126c303-03c2-4092-a3c9-3013d518bfe7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:45.394739 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6126c303-03c2-4092-a3c9-3013d518bfe7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:45.395191 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6126c303-03c2-4092-a3c9-3013d518bfe7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:45.396176 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6126c303-03c2-4092-a3c9-3013d518bfe7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:45.396697 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6126c303-03c2-4092-a3c9-3013d518bfe7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:45.530198 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6126c303-03c2-4092-a3c9-3013d518bfe7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:45.538884 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6126c303-03c2-4092-a3c9-3013d518bfe7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:45.540404 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6126c303-03c2-4092-a3c9-3013d518bfe7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:45.541569 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6126c303-03c2-4092-a3c9-3013d518bfe7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.158517 May 10 16:54:45.542133 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 378/784] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:45 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:45.960949 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-31e94021-de9f-49b5-9fe9-33ec1072cc10 req-6d6a7ee6-db92-4e39-b756-1b80e72aacdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94042c88-ecb2-484f-8a2c-df1d0ecae7a6", "tag": "c2215c98-d2de-4899-bfa6-5f508d8a56aa"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:45.967675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8f725790-9f7c-48e1-93c7-c1720250086a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:45.969546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8f725790-9f7c-48e1-93c7-c1720250086a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:45.979512 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f725790-9f7c-48e1-93c7-c1720250086a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:45.979896 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f725790-9f7c-48e1-93c7-c1720250086a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:45.982163 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-31e94021-de9f-49b5-9fe9-33ec1072cc10 req-6d6a7ee6-db92-4e39-b756-1b80e72aacdd service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:45.982309 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f725790-9f7c-48e1-93c7-c1720250086a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:45.982777 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f725790-9f7c-48e1-93c7-c1720250086a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:45.983084 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-31e94021-de9f-49b5-9fe9-33ec1072cc10 req-6d6a7ee6-db92-4e39-b756-1b80e72aacdd service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:46.002008 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-31e94021-de9f-49b5-9fe9-33ec1072cc10 req-6d6a7ee6-db92-4e39-b756-1b80e72aacdd service nova] Creating event network-changed:c2215c98-d2de-4899-bfa6-5f508d8a56aa for instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 on hv-cinder-83588 May 10 16:54:46.009429 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-31e94021-de9f-49b5-9fe9-33ec1072cc10 req-6d6a7ee6-db92-4e39-b756-1b80e72aacdd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057071 May 10 16:54:46.010463 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 407/785] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:54:46.151541 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8f725790-9f7c-48e1-93c7-c1720250086a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:46.160544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8f725790-9f7c-48e1-93c7-c1720250086a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1366 microversion: 2.1 time: 0.205901 May 10 16:54:46.161201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 379/786] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:45 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:54:46.559582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1dc71ab0-548b-4395-8265-1ebeb9bc7b90 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:46.560409 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1dc71ab0-548b-4395-8265-1ebeb9bc7b90 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:46.566798 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1dc71ab0-548b-4395-8265-1ebeb9bc7b90 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:46.567254 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1dc71ab0-548b-4395-8265-1ebeb9bc7b90 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:46.568059 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1dc71ab0-548b-4395-8265-1ebeb9bc7b90 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:46.568518 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1dc71ab0-548b-4395-8265-1ebeb9bc7b90 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:46.702091 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1dc71ab0-548b-4395-8265-1ebeb9bc7b90 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:46.710444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1dc71ab0-548b-4395-8265-1ebeb9bc7b90 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:46.711984 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1dc71ab0-548b-4395-8265-1ebeb9bc7b90 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:46.713188 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1dc71ab0-548b-4395-8265-1ebeb9bc7b90 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.157940 May 10 16:54:46.713758 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 408/787] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:46 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:47.178150 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ff4319c0-2655-4a4e-8ad2-77c6e8915e0a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:47.178794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ff4319c0-2655-4a4e-8ad2-77c6e8915e0a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:47.185614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff4319c0-2655-4a4e-8ad2-77c6e8915e0a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:47.186067 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff4319c0-2655-4a4e-8ad2-77c6e8915e0a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:47.186839 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff4319c0-2655-4a4e-8ad2-77c6e8915e0a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:47.187281 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ff4319c0-2655-4a4e-8ad2-77c6e8915e0a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:47.329345 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ff4319c0-2655-4a4e-8ad2-77c6e8915e0a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:47.336775 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ff4319c0-2655-4a4e-8ad2-77c6e8915e0a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1366 microversion: 2.1 time: 0.162669 May 10 16:54:47.337354 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 380/788] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:47 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:47.736648 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-caf53944-965f-4ac6-8fed-d188fa98d7ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:47.737377 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-caf53944-965f-4ac6-8fed-d188fa98d7ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:47.743764 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-caf53944-965f-4ac6-8fed-d188fa98d7ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:47.743923 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-caf53944-965f-4ac6-8fed-d188fa98d7ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:47.748770 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-caf53944-965f-4ac6-8fed-d188fa98d7ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:47.748770 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-caf53944-965f-4ac6-8fed-d188fa98d7ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:47.874174 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-caf53944-965f-4ac6-8fed-d188fa98d7ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:47.882024 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-caf53944-965f-4ac6-8fed-d188fa98d7ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:47.883558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-caf53944-965f-4ac6-8fed-d188fa98d7ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:47.884766 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-caf53944-965f-4ac6-8fed-d188fa98d7ff tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.152905 May 10 16:54:47.885324 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 409/789] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:47 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:48.354434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f08cef94-8d15-4b9d-9e72-22906b0f0ff2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:48.355144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f08cef94-8d15-4b9d-9e72-22906b0f0ff2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:48.362159 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f08cef94-8d15-4b9d-9e72-22906b0f0ff2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:48.362691 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f08cef94-8d15-4b9d-9e72-22906b0f0ff2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:48.363600 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f08cef94-8d15-4b9d-9e72-22906b0f0ff2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:48.364026 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f08cef94-8d15-4b9d-9e72-22906b0f0ff2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:48.530030 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f08cef94-8d15-4b9d-9e72-22906b0f0ff2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:48.537791 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f08cef94-8d15-4b9d-9e72-22906b0f0ff2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1366 microversion: 2.1 time: 0.187209 May 10 16:54:48.538553 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 381/790] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:48 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:48.866157 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-ce952495-4175-48a0-aa18-a8c00a268dd0 req-671b193b-a717-428d-a786-20431d08b9ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c65f78-2474-4331-ad66-738a8ac2162c", "name": "network-vif-plugged", "status": "completed", "tag": "b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:48.876502 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-ce952495-4175-48a0-aa18-a8c00a268dd0 req-671b193b-a717-428d-a786-20431d08b9ef service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:48.877175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-ce952495-4175-48a0-aa18-a8c00a268dd0 req-671b193b-a717-428d-a786-20431d08b9ef service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:48.891061 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-ce952495-4175-48a0-aa18-a8c00a268dd0 req-671b193b-a717-428d-a786-20431d08b9ef service nova] Creating event network-vif-plugged:b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b for instance a8c65f78-2474-4331-ad66-738a8ac2162c on hv-cinder-83588 May 10 16:54:48.896934 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-ce952495-4175-48a0-aa18-a8c00a268dd0 req-671b193b-a717-428d-a786-20431d08b9ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034799 May 10 16:54:48.903110 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-fd55ab3e-4ac2-43b7-8c92-bae461198250 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:48.904006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-fd55ab3e-4ac2-43b7-8c92-bae461198250 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:48.907036 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 410/791] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:54:48.910418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fd55ab3e-4ac2-43b7-8c92-bae461198250 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:48.911074 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fd55ab3e-4ac2-43b7-8c92-bae461198250 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:48.912749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fd55ab3e-4ac2-43b7-8c92-bae461198250 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:48.913351 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fd55ab3e-4ac2-43b7-8c92-bae461198250 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:49.089827 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-fd55ab3e-4ac2-43b7-8c92-bae461198250 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:49.098545 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-fd55ab3e-4ac2-43b7-8c92-bae461198250 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:49.101756 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-fd55ab3e-4ac2-43b7-8c92-bae461198250 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:49.103614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-fd55ab3e-4ac2-43b7-8c92-bae461198250 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.204286 May 10 16:54:49.104754 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 382/792] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:48 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:54:49.555622 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f6398260-2c38-4f61-9766-0a73da9d1f01 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:49.556237 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f6398260-2c38-4f61-9766-0a73da9d1f01 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:49.562409 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f6398260-2c38-4f61-9766-0a73da9d1f01 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:49.562861 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f6398260-2c38-4f61-9766-0a73da9d1f01 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:49.563636 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f6398260-2c38-4f61-9766-0a73da9d1f01 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:49.564104 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f6398260-2c38-4f61-9766-0a73da9d1f01 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:49.697613 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f6398260-2c38-4f61-9766-0a73da9d1f01 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:49.706380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f6398260-2c38-4f61-9766-0a73da9d1f01 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1366 microversion: 2.1 time: 0.154679 May 10 16:54:49.706973 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 411/793] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:49 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:50.123483 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f06e4581-3361-4fb3-9e5a-7baf8aa1fffe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:50.124089 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f06e4581-3361-4fb3-9e5a-7baf8aa1fffe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:50.130392 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f06e4581-3361-4fb3-9e5a-7baf8aa1fffe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:50.130832 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f06e4581-3361-4fb3-9e5a-7baf8aa1fffe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:50.131602 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f06e4581-3361-4fb3-9e5a-7baf8aa1fffe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:50.132033 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f06e4581-3361-4fb3-9e5a-7baf8aa1fffe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:50.264528 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f06e4581-3361-4fb3-9e5a-7baf8aa1fffe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:50.272292 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f06e4581-3361-4fb3-9e5a-7baf8aa1fffe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:50.273787 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f06e4581-3361-4fb3-9e5a-7baf8aa1fffe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:50.274935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f06e4581-3361-4fb3-9e5a-7baf8aa1fffe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.156355 May 10 16:54:50.275503 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 383/794] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:50 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:50.723939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f81f7ee0-b1c3-4ad1-be1a-c34d595065da tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:50.724577 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f81f7ee0-b1c3-4ad1-be1a-c34d595065da tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:50.733304 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f81f7ee0-b1c3-4ad1-be1a-c34d595065da tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:50.733304 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f81f7ee0-b1c3-4ad1-be1a-c34d595065da tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:50.733978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f81f7ee0-b1c3-4ad1-be1a-c34d595065da tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:50.734425 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f81f7ee0-b1c3-4ad1-be1a-c34d595065da tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:50.891850 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f81f7ee0-b1c3-4ad1-be1a-c34d595065da tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:50.899495 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f81f7ee0-b1c3-4ad1-be1a-c34d595065da tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1366 microversion: 2.1 time: 0.179222 May 10 16:54:50.900069 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 412/795] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:50 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:50.915121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-680bfea9-f949-406b-9329-76767886fedf req-05b90c4a-d6c4-4faf-aef9-2c52f7f32179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94042c88-ecb2-484f-8a2c-df1d0ecae7a6", "name": "network-vif-plugged", "status": "completed", "tag": "c2215c98-d2de-4899-bfa6-5f508d8a56aa"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:50.925928 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-680bfea9-f949-406b-9329-76767886fedf req-05b90c4a-d6c4-4faf-aef9-2c52f7f32179 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:50.926382 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-680bfea9-f949-406b-9329-76767886fedf req-05b90c4a-d6c4-4faf-aef9-2c52f7f32179 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:50.938595 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-680bfea9-f949-406b-9329-76767886fedf req-05b90c4a-d6c4-4faf-aef9-2c52f7f32179 service nova] Creating event network-vif-plugged:c2215c98-d2de-4899-bfa6-5f508d8a56aa for instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 on hv-cinder-83588 May 10 16:54:50.943518 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-680bfea9-f949-406b-9329-76767886fedf req-05b90c4a-d6c4-4faf-aef9-2c52f7f32179 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032700 May 10 16:54:50.944181 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 384/796] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:54:51.293987 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9778c52a-2aef-4dcf-b76f-76a150b6446f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:51.294797 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9778c52a-2aef-4dcf-b76f-76a150b6446f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:51.300735 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9778c52a-2aef-4dcf-b76f-76a150b6446f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:51.301193 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9778c52a-2aef-4dcf-b76f-76a150b6446f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:51.301970 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9778c52a-2aef-4dcf-b76f-76a150b6446f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:51.302412 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9778c52a-2aef-4dcf-b76f-76a150b6446f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:51.456889 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9778c52a-2aef-4dcf-b76f-76a150b6446f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:51.466435 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9778c52a-2aef-4dcf-b76f-76a150b6446f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:51.477029 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9778c52a-2aef-4dcf-b76f-76a150b6446f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:51.478232 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9778c52a-2aef-4dcf-b76f-76a150b6446f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1730 microversion: 2.20 time: 0.188950 May 10 16:54:51.478795 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 413/797] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:51 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:51.917456 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-97998822-32cb-4be2-b0f6-2133a57a46f6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:51.918389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-97998822-32cb-4be2-b0f6-2133a57a46f6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:51.924825 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-97998822-32cb-4be2-b0f6-2133a57a46f6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:51.925282 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-97998822-32cb-4be2-b0f6-2133a57a46f6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:51.926050 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-97998822-32cb-4be2-b0f6-2133a57a46f6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:51.926519 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-97998822-32cb-4be2-b0f6-2133a57a46f6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:52.060054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-97998822-32cb-4be2-b0f6-2133a57a46f6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:52.067448 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-97998822-32cb-4be2-b0f6-2133a57a46f6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1366 microversion: 2.1 time: 0.154611 May 10 16:54:52.068025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 385/798] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:51 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:52.498492 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3f961d6f-fb87-4bf1-b372-676d3179db4c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:52.499094 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3f961d6f-fb87-4bf1-b372-676d3179db4c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:52.505992 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3f961d6f-fb87-4bf1-b372-676d3179db4c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:52.506568 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3f961d6f-fb87-4bf1-b372-676d3179db4c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:52.507638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3f961d6f-fb87-4bf1-b372-676d3179db4c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:52.508174 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3f961d6f-fb87-4bf1-b372-676d3179db4c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:52.661705 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3f961d6f-fb87-4bf1-b372-676d3179db4c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:52.668577 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3f961d6f-fb87-4bf1-b372-676d3179db4c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:52.670319 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3f961d6f-fb87-4bf1-b372-676d3179db4c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:52.671582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3f961d6f-fb87-4bf1-b372-676d3179db4c tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1717 microversion: 2.20 time: 0.177220 May 10 16:54:52.672593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 414/799] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:54:52 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1717 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:54:53.084047 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c5b880c1-41ef-4163-bd55-78d56379abb4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:53.084698 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c5b880c1-41ef-4163-bd55-78d56379abb4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:53.092037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c5b880c1-41ef-4163-bd55-78d56379abb4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:53.092529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c5b880c1-41ef-4163-bd55-78d56379abb4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:53.093309 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c5b880c1-41ef-4163-bd55-78d56379abb4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:53.093749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c5b880c1-41ef-4163-bd55-78d56379abb4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:53.222108 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c5b880c1-41ef-4163-bd55-78d56379abb4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:54:53.229306 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c5b880c1-41ef-4163-bd55-78d56379abb4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1556 microversion: 2.1 time: 0.149178 May 10 16:54:53.229869 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 386/800] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:54:53 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:54:53.245752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-66563eb0-81ac-4030-b285-d06e04c7ff34 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:54:53.247128 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-66563eb0-81ac-4030-b285-d06e04c7ff34 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:54:53.253093 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-66563eb0-81ac-4030-b285-d06e04c7ff34 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:53.253549 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-66563eb0-81ac-4030-b285-d06e04c7ff34 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:53.254326 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-66563eb0-81ac-4030-b285-d06e04c7ff34 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:53.254769 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-66563eb0-81ac-4030-b285-d06e04c7ff34 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:53.331703 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-66563eb0-81ac-4030-b285-d06e04c7ff34 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089819 May 10 16:54:53.332341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 415/801] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 10 16:54:53 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:54:54.328241 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-6f8fcecc-7583-4377-98b5-e015121192c3 req-c8beb66b-7aeb-4249-979e-4e34528a6f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94042c88-ecb2-484f-8a2c-df1d0ecae7a6", "tag": "c2215c98-d2de-4899-bfa6-5f508d8a56aa"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:54:54.336999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-6f8fcecc-7583-4377-98b5-e015121192c3 req-c8beb66b-7aeb-4249-979e-4e34528a6f07 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:54:54.337493 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-6f8fcecc-7583-4377-98b5-e015121192c3 req-c8beb66b-7aeb-4249-979e-4e34528a6f07 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:54:54.348809 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-6f8fcecc-7583-4377-98b5-e015121192c3 req-c8beb66b-7aeb-4249-979e-4e34528a6f07 service nova] Creating event network-changed:c2215c98-d2de-4899-bfa6-5f508d8a56aa for instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 on hv-cinder-83588 May 10 16:54:54.354184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-6f8fcecc-7583-4377-98b5-e015121192c3 req-c8beb66b-7aeb-4249-979e-4e34528a6f07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029568 May 10 16:54:54.355842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 387/802] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:18.432329 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-48d05bb8-b9db-4f0a-99d4-faa357106771 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Action: 'create', calling method: .version_select at 0x7f5fbfeba160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-578502746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaSWmryCUp0UBYp/uk8SosH0ypaY90Jz1enlnnacwPf9rMJYLhhuExooy7tIB2ShT+DYvnQIDnTG84/t0n6eCwysv1/MYTacS8HMscpfjgAhHUfYktkT9mkAfaZvWLiMA=="}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:18.447754 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-48d05bb8-b9db-4f0a-99d4-faa357106771 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Getting quotas for project 0b8348f4bffd44e7b0da6367a1011709. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:55:18.452673 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-48d05bb8-b9db-4f0a-99d4-faa357106771 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Getting quotas for user fe1f5f6882eb4a9aa869ad32fbdb0d92 and project 0b8348f4bffd44e7b0da6367a1011709. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:55:18.476200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-48d05bb8-b9db-4f0a-99d4-faa357106771 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.207488 May 10 16:55:18.476829 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 416/803] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 10 16:55:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:24.734609 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b050e905-e465-4ebe-ade6-c2e54e8d9e65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:24.735609 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b050e905-e465-4ebe-ade6-c2e54e8d9e65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:24.741822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b050e905-e465-4ebe-ade6-c2e54e8d9e65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:24.742272 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b050e905-e465-4ebe-ade6-c2e54e8d9e65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:24.743036 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b050e905-e465-4ebe-ade6-c2e54e8d9e65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:24.743474 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b050e905-e465-4ebe-ade6-c2e54e8d9e65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:24.774658 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b050e905-e465-4ebe-ade6-c2e54e8d9e65 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045920 May 10 16:55:24.775228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 388/804] 10.222.0.48 () {60 vars in 1342 bytes} [Tue May 10 16:55:24 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:24.840542 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e8d1670d-69d2-4963-bd94-34a519242ef7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:24.841151 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e8d1670d-69d2-4963-bd94-34a519242ef7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:24.847993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8d1670d-69d2-4963-bd94-34a519242ef7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:24.848479 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8d1670d-69d2-4963-bd94-34a519242ef7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:24.849272 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8d1670d-69d2-4963-bd94-34a519242ef7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:24.849710 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8d1670d-69d2-4963-bd94-34a519242ef7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:24.875275 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e8d1670d-69d2-4963-bd94-34a519242ef7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Going to try to terminate instance {{(pid=134195) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:55:24.952307 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e8d1670d-69d2-4963-bd94-34a519242ef7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 204 len: 0 microversion: 2.20 time: 0.115680 May 10 16:55:24.952307 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 417/805] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 10 16:55:24 2022] DELETE /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 16:55:24.960882 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ee1ce43d-20d2-45c3-b3fc-216ba029ced7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:24.961588 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ee1ce43d-20d2-45c3-b3fc-216ba029ced7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:24.968550 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ee1ce43d-20d2-45c3-b3fc-216ba029ced7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:24.968992 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ee1ce43d-20d2-45c3-b3fc-216ba029ced7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:24.969752 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ee1ce43d-20d2-45c3-b3fc-216ba029ced7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:24.970185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ee1ce43d-20d2-45c3-b3fc-216ba029ced7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:25.104864 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ee1ce43d-20d2-45c3-b3fc-216ba029ced7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:25.113715 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ee1ce43d-20d2-45c3-b3fc-216ba029ced7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:25.115211 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ee1ce43d-20d2-45c3-b3fc-216ba029ced7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:25.116424 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ee1ce43d-20d2-45c3-b3fc-216ba029ced7 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.159957 May 10 16:55:25.116985 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 389/806] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:55:24 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:55:26.137748 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-71be96ee-da2c-4e29-80d6-f44c55404919 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:26.138441 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-71be96ee-da2c-4e29-80d6-f44c55404919 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:26.144949 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-71be96ee-da2c-4e29-80d6-f44c55404919 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:26.145401 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-71be96ee-da2c-4e29-80d6-f44c55404919 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:26.146405 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-71be96ee-da2c-4e29-80d6-f44c55404919 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:26.146993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-71be96ee-da2c-4e29-80d6-f44c55404919 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:26.283289 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-71be96ee-da2c-4e29-80d6-f44c55404919 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:26.291689 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-71be96ee-da2c-4e29-80d6-f44c55404919 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:26.293882 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-71be96ee-da2c-4e29-80d6-f44c55404919 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:26.295208 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-71be96ee-da2c-4e29-80d6-f44c55404919 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1723 microversion: 2.20 time: 0.161946 May 10 16:55:26.295763 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 418/807] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:55:26 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:55:27.313842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-bb3fea3a-6c73-44d0-a5e0-9088dbf3529f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:27.314451 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-bb3fea3a-6c73-44d0-a5e0-9088dbf3529f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:27.321030 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb3fea3a-6c73-44d0-a5e0-9088dbf3529f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:27.321496 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb3fea3a-6c73-44d0-a5e0-9088dbf3529f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:27.322416 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb3fea3a-6c73-44d0-a5e0-9088dbf3529f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:27.322710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb3fea3a-6c73-44d0-a5e0-9088dbf3529f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:27.364213 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-a9a22091-f826-4fe4-82f4-5c0a7706d656 req-f50d6129-2889-415c-864b-23808344ed34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c65f78-2474-4331-ad66-738a8ac2162c", "name": "network-vif-deleted", "tag": "b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:27.374618 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-a9a22091-f826-4fe4-82f4-5c0a7706d656 req-f50d6129-2889-415c-864b-23808344ed34 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:27.375381 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-a9a22091-f826-4fe4-82f4-5c0a7706d656 req-f50d6129-2889-415c-864b-23808344ed34 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:27.390538 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-a9a22091-f826-4fe4-82f4-5c0a7706d656 req-f50d6129-2889-415c-864b-23808344ed34 service nova] Creating event network-vif-deleted:b2c3c4a1-bfef-4200-a34a-33c3cba6ea6b for instance a8c65f78-2474-4331-ad66-738a8ac2162c on hv-cinder-83588 May 10 16:55:27.398662 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-a9a22091-f826-4fe4-82f4-5c0a7706d656 req-f50d6129-2889-415c-864b-23808344ed34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038570 May 10 16:55:27.399305 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 419/808] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:27.415497 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-bb3fea3a-6c73-44d0-a5e0-9088dbf3529f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:27.428689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-bb3fea3a-6c73-44d0-a5e0-9088dbf3529f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:27.430565 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-bb3fea3a-6c73-44d0-a5e0-9088dbf3529f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '25229d5ef3be47988accfdee5f9209b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26f2126d1804c3caf0f83a1eb47fbff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:27.431854 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-bb3fea3a-6c73-44d0-a5e0-9088dbf3529f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 200 len: 1655 microversion: 2.20 time: 0.122171 May 10 16:55:27.432939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 390/809] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:55:27 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 1655 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:55:28.453297 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b570c097-5e81-49d0-b7bd-2f91b4736726 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:28.453994 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b570c097-5e81-49d0-b7bd-2f91b4736726 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:28.460491 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b570c097-5e81-49d0-b7bd-2f91b4736726 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:28.460979 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b570c097-5e81-49d0-b7bd-2f91b4736726 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:28.461757 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b570c097-5e81-49d0-b7bd-2f91b4736726 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:28.462192 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b570c097-5e81-49d0-b7bd-2f91b4736726 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:28.477330 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-b570c097-5e81-49d0-b7bd-2f91b4736726 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] HTTP exception thrown: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b570c097-5e81-49d0-b7bd-2f91b4736726 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Request method failure captured: May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c HTTP/1.1 May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdNjmY01frvymW2xtFv8Bebf9L_QLGU7XWg_XL1EZ9eUJgtDsx1Qw4Ton1kx7cJXTZlHfAlqf64bN2bkPTVXsq0x8OUyNMV7nO3QMXfNjkT1UJ6okcd8xi184YFpVR68wILRIgF-f8PwCTQHXzMRc_y4_K-z8DNbLeoVCDO0dr2koc May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:55:28.480354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 25229d5ef3be47988accfdee5f9209b8 May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:28.482137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'a8c65f78-2474-4331-ad66-738a8ac2162c'} May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:28.483344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:28.484626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:28.485750 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b570c097-5e81-49d0-b7bd-2f91b4736726 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Returning 404 to user: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:28.485750 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b570c097-5e81-49d0-b7bd-2f91b4736726 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 404 len: 111 microversion: 2.20 time: 0.034491 May 10 16:55:28.485750 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 420/810] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:55:28 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 16:55:28.491027 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7cefac2a-bea3-4a85-ac86-ff39a9539db9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '.version_select at 0x7f5fb6aa0940>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:28.510501 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7cefac2a-bea3-4a85-ac86-ff39a9539db9 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-197847241" status: 204 len: 0 microversion: 2.20 time: 0.023665 May 10 16:55:28.511326 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 391/811] 10.222.0.48 () {60 vars in 1258 bytes} [Tue May 10 16:55:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-197847241 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 16:55:30.273242 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-eea4ebde-50c9-43b7-9654-e21c5d53e3fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:30.273731 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-eea4ebde-50c9-43b7-9654-e21c5d53e3fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:30.280249 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eea4ebde-50c9-43b7-9654-e21c5d53e3fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:30.280721 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eea4ebde-50c9-43b7-9654-e21c5d53e3fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:30.281481 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eea4ebde-50c9-43b7-9654-e21c5d53e3fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:30.281911 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eea4ebde-50c9-43b7-9654-e21c5d53e3fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:30.295546 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-eea4ebde-50c9-43b7-9654-e21c5d53e3fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] HTTP exception thrown: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-eea4ebde-50c9-43b7-9654-e21c5d53e3fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Request method failure captured: May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: DELETE /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c HTTP/1.1 May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdNjmY01frvymW2xtFv8Bebf9L_QLGU7XWg_XL1EZ9eUJgtDsx1Qw4Ton1kx7cJXTZlHfAlqf64bN2bkPTVXsq0x8OUyNMV7nO3QMXfNjkT1UJ6okcd8xi184YFpVR68wILRIgF-f8PwCTQHXzMRc_y4_K-z8DNbLeoVCDO0dr2koc May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:55:30.297097 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 25229d5ef3be47988accfdee5f9209b8 May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:30.298936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'a8c65f78-2474-4331-ad66-738a8ac2162c'} May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:30.299830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:30.301376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:30.302836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-eea4ebde-50c9-43b7-9654-e21c5d53e3fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Returning 404 to user: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:30.302836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-eea4ebde-50c9-43b7-9654-e21c5d53e3fe tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 404 len: 111 microversion: 2.20 time: 0.029179 May 10 16:55:30.302836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 421/812] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 10 16:55:30 2022] DELETE /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 16:55:30.307818 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-fc6e26d9-f4f9-4454-bcf7-1afd0d786f5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:30.309311 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-fc6e26d9-f4f9-4454-bcf7-1afd0d786f5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: a8c65f78-2474-4331-ad66-738a8ac2162c] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:30.317480 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fc6e26d9-f4f9-4454-bcf7-1afd0d786f5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:30.317942 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fc6e26d9-f4f9-4454-bcf7-1afd0d786f5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:30.318701 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fc6e26d9-f4f9-4454-bcf7-1afd0d786f5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:30.319139 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fc6e26d9-f4f9-4454-bcf7-1afd0d786f5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:30.331961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-fc6e26d9-f4f9-4454-bcf7-1afd0d786f5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] HTTP exception thrown: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-fc6e26d9-f4f9-4454-bcf7-1afd0d786f5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Request method failure captured: May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c HTTP/1.1 May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepdNjmY01frvymW2xtFv8Bebf9L_QLGU7XWg_XL1EZ9eUJgtDsx1Qw4Ton1kx7cJXTZlHfAlqf64bN2bkPTVXsq0x8OUyNMV7nO3QMXfNjkT1UJ6okcd8xi184YFpVR68wILRIgF-f8PwCTQHXzMRc_y4_K-z8DNbLeoVCDO0dr2koc May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:55:30.333612 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 25229d5ef3be47988accfdee5f9209b8 May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:30.335274 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': 'a8c65f78-2474-4331-ad66-738a8ac2162c'} May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:30.336714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. May 10 16:55:30.338228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:30.340178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-fc6e26d9-f4f9-4454-bcf7-1afd0d786f5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Returning 404 to user: Instance a8c65f78-2474-4331-ad66-738a8ac2162c could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:30.340178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-fc6e26d9-f4f9-4454-bcf7-1afd0d786f5f tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c" status: 404 len: 111 microversion: 2.20 time: 0.031598 May 10 16:55:30.340178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 392/813] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:55:30 2022] GET /compute/v2.1/servers/a8c65f78-2474-4331-ad66-738a8ac2162c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 16:55:30.554845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-7ad46a40-c032-4859-9eda-d7ff5e8f35fe tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:30.555354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-7ad46a40-c032-4859-9eda-d7ff5e8f35fe tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:30.562849 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7ad46a40-c032-4859-9eda-d7ff5e8f35fe tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:30.563302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7ad46a40-c032-4859-9eda-d7ff5e8f35fe tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:30.564112 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7ad46a40-c032-4859-9eda-d7ff5e8f35fe tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:30.564630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-7ad46a40-c032-4859-9eda-d7ff5e8f35fe tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:30.589890 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-7ad46a40-c032-4859-9eda-d7ff5e8f35fe tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/ips" status: 200 len: 150 microversion: 2.1 time: 0.038680 May 10 16:55:30.591128 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 422/814] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 10 16:55:30 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:31.470956 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c27a8867-2f01-479f-b82b-791af8b91aeb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:31.471459 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c27a8867-2f01-479f-b82b-791af8b91aeb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:31.477797 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c27a8867-2f01-479f-b82b-791af8b91aeb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:31.478255 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c27a8867-2f01-479f-b82b-791af8b91aeb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:31.479031 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c27a8867-2f01-479f-b82b-791af8b91aeb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:31.479472 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c27a8867-2f01-479f-b82b-791af8b91aeb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:31.496448 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-c27a8867-2f01-479f-b82b-791af8b91aeb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] HTTP exception thrown: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c27a8867-2f01-479f-b82b-791af8b91aeb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Request method failure captured: May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: DELETE /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b HTTP/1.1 May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepdNjmY01frvymW2xtFv8Bebf9L_QLGU7XWg_XL1EZ9eUJgtDsx1Qw4Ton1kx7cJXTZlHfAlqf64bN2bkPTVXsq0x8OUyNMV7nO3QMXfNjkT1UJ6okcd8xi184YFpVR68wILRIgF-f8PwCTQHXzMRc_y4_K-z8DNbLeoVCDO0dr2koc May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:55:31.498526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 25229d5ef3be47988accfdee5f9209b8 May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:55:31.500155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': 'c6739110-4e68-4993-83ec-7c1503f7b87b'} May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:31.501184 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:55:31.502637 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:31.504394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c27a8867-2f01-479f-b82b-791af8b91aeb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Returning 404 to user: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:31.504394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c27a8867-2f01-479f-b82b-791af8b91aeb tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 404 len: 111 microversion: 2.20 time: 0.034765 May 10 16:55:31.504394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 393/815] 10.222.0.48 () {60 vars in 1279 bytes} [Tue May 10 16:55:31 2022] DELETE /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 16:55:31.508793 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e7b66bba-73ac-4302-a531-15bb290f8a35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:31.509406 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e7b66bba-73ac-4302-a531-15bb290f8a35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] [instance: c6739110-4e68-4993-83ec-7c1503f7b87b] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:31.516537 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e7b66bba-73ac-4302-a531-15bb290f8a35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:31.516993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e7b66bba-73ac-4302-a531-15bb290f8a35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:31.517765 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e7b66bba-73ac-4302-a531-15bb290f8a35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:31.518207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e7b66bba-73ac-4302-a531-15bb290f8a35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:31.531106 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-e7b66bba-73ac-4302-a531-15bb290f8a35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] HTTP exception thrown: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e7b66bba-73ac-4302-a531-15bb290f8a35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Request method failure captured: May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b HTTP/1.1 May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepdNjmY01frvymW2xtFv8Bebf9L_QLGU7XWg_XL1EZ9eUJgtDsx1Qw4Ton1kx7cJXTZlHfAlqf64bN2bkPTVXsq0x8OUyNMV7nO3QMXfNjkT1UJ6okcd8xi184YFpVR68wILRIgF-f8PwCTQHXzMRc_y4_K-z8DNbLeoVCDO0dr2koc May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:55:31.532641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a26f2126d1804c3caf0f83a1eb47fbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: a26f2126d1804c3caf0f83a1eb47fbff May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1563510481 May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 25229d5ef3be47988accfdee5f9209b8 May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1563510481-project May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:55:31.534243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'c6739110-4e68-4993-83ec-7c1503f7b87b'} May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:31.535111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. May 10 16:55:31.536544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:31.537923 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e7b66bba-73ac-4302-a531-15bb290f8a35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] Returning 404 to user: Instance c6739110-4e68-4993-83ec-7c1503f7b87b could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:31.537923 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e7b66bba-73ac-4302-a531-15bb290f8a35 tempest-AttachVolumeShelveTestJSON-1563510481 tempest-AttachVolumeShelveTestJSON-1563510481-project] 10.222.0.48 "GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b" status: 404 len: 111 microversion: 2.20 time: 0.029074 May 10 16:55:31.537923 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 423/816] 10.222.0.48 () {60 vars in 1276 bytes} [Tue May 10 16:55:31 2022] GET /compute/v2.1/servers/c6739110-4e68-4993-83ec-7c1503f7b87b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 16:55:31.938234 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7c93598d-6154-45a5-90e5-72841c7d2a56 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea150517-4d6f-4ba3-8456-03e639506e42"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:31.939284 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7c93598d-6154-45a5-90e5-72841c7d2a56 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:31.945157 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7c93598d-6154-45a5-90e5-72841c7d2a56 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:31.945605 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7c93598d-6154-45a5-90e5-72841c7d2a56 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:31.946362 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7c93598d-6154-45a5-90e5-72841c7d2a56 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:31.946796 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7c93598d-6154-45a5-90e5-72841c7d2a56 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:32.187785 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7c93598d-6154-45a5-90e5-72841c7d2a56 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253335 May 10 16:55:32.188438 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 394/817] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:55:31 2022] POST /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:34.753821 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1339248096", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-578502746", "security_groups": [{"name": "tempest-secgroup-smoke-1747529592"}], "block_device_mapping_v2": [{"uuid": "9f7bc6e6-e41d-4062-b5b7-8dee93ac7237", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4630e6fb-ee22-4d27-bd44-871c41a7cdec"}]}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:34.921642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.network.neutron [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] validate_networks() for [('4630e6fb-ee22-4d27-bd44-871c41a7cdec', None, None, None, None, None)] {{(pid=134195) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:55:35.398892 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Flavor limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:55:35.399317 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Image limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:55:35.399790 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Flavor pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:55:35.400197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Image pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:55:35.401039 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:55:35.418114 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:35.418809 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:35.420621 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:35.421947 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:35.442797 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Getting quotas for project 0b8348f4bffd44e7b0da6367a1011709. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:55:35.447203 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Getting quotas for user fe1f5f6882eb4a9aa869ad32fbdb0d92 and project 0b8348f4bffd44e7b0da6367a1011709. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:55:35.506095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Going to run 1 instances... {{(pid=134195) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:55:35.508220 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f7bc6e6-e41d-4062-b5b7-8dee93ac7237',volume_size=None,volume_type=None)] {{(pid=134195) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:55:35.643821 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-03ebc29b-98cd-45d0-885a-f8a73f9715af tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.893814 May 10 16:55:35.644614 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 424/818] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:55:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:55:35.656028 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-413defeb-f3e9-4b51-bf9f-8aba84d55253 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:35.656834 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-413defeb-f3e9-4b51-bf9f-8aba84d55253 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:35.714726 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-413defeb-f3e9-4b51-bf9f-8aba84d55253 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:35.721986 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-413defeb-f3e9-4b51-bf9f-8aba84d55253 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1094 microversion: 2.1 time: 0.070812 May 10 16:55:35.722490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 395/819] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:35 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:36.272162 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3ab1c96f-3e72-4d32-af8a-51581f80606c tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Action: 'create', calling method: .version_select at 0x7f5fbfefc040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1536250588", "metadata": {"Type": "work"}}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3ab1c96f-3e72-4d32-af8a-51581f80606c tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Request method failure captured: May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 122 May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepkIchTd944RdxhWWoQITkz7ItIyJRXyvqiASl6xFzro_-CKdOajRmt4-sCG75cDm2tT0KJHAJF3BYes40VtNb9174cZrMSIZX8HCfL3fhhmACF8qNmSYImnCqhABE_IdWzPpLENq7TapQ0Rh6XZkLbDcYDLxeWri7iiRFOvgwwCpvs May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:55:36.281558 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 4d1852e813a94512b41e0bae8cbc57d4 May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1536250588", "metadata": {"Type": "work"}}} May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: May 10 16:55:36.283243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1536250588', 'metadata': {'Type': 'work'}}}} May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise error May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi '#$%' May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:36.284108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 16:55:36.285720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 16:55:36.287107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 16:55:36.287107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.287107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3ab1c96f-3e72-4d32-af8a-51581f80606c tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:36.287107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3ab1c96f-3e72-4d32-af8a-51581f80606c tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.127306 May 10 16:55:36.287107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 425/820] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 10 16:55:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 16:55:36.293037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-816bab49-3892-41ea-b883-6a009f54a616 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Action: 'create', calling method: .version_select at 0x7f5fb6b2a8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1075349504", "metadata": {"Type": "work"}}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-816bab49-3892-41ea-b883-6a009f54a616 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Request method failure captured: May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 120 May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepkIchTd944RdxhWWoQITkz7ItIyJRXyvqiASl6xFzro_-CKdOajRmt4-sCG75cDm2tT0KJHAJF3BYes40VtNb9174cZrMSIZX8HCfL3fhhmACF8qNmSYImnCqhABE_IdWzPpLENq7TapQ0Rh6XZkLbDcYDLxeWri7iiRFOvgwwCpvs May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:55:36.299155 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 4d1852e813a94512b41e0bae8cbc57d4 May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1075349504", "metadata": {"Type": "work"}}} May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: May 10 16:55:36.300793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1075349504', 'metadata': {'Type': 'work'}}}} May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise error May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi '0' May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:36.301755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 16:55:36.303365 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 16:55:36.305118 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 16:55:36.305118 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.305118 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-816bab49-3892-41ea-b883-6a009f54a616 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:36.305118 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-816bab49-3892-41ea-b883-6a009f54a616 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011732 May 10 16:55:36.305118 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 396/821] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 10 16:55:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 16:55:36.311700 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b4ee0120-de96-4e9f-aabb-ee7007969440 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Action: 'create', calling method: .version_select at 0x7f5fb63803a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-914357827", "metadata": {"Type": "work"}}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b4ee0120-de96-4e9f-aabb-ee7007969440 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Request method failure captured: May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 118 May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepkIchTd944RdxhWWoQITkz7ItIyJRXyvqiASl6xFzro_-CKdOajRmt4-sCG75cDm2tT0KJHAJF3BYes40VtNb9174cZrMSIZX8HCfL3fhhmACF8qNmSYImnCqhABE_IdWzPpLENq7TapQ0Rh6XZkLbDcYDLxeWri7iiRFOvgwwCpvs May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:55:36.314003 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 4d1852e813a94512b41e0bae8cbc57d4 May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-914357827", "metadata": {"Type": "work"}}} May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: May 10 16:55:36.315654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-914357827', 'metadata': {'Type': 'work'}}}} May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise error May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi '' May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:36.316532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 16:55:36.317864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 16:55:36.319055 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 16:55:36.319055 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.319055 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b4ee0120-de96-4e9f-aabb-ee7007969440 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:36.319055 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b4ee0120-de96-4e9f-aabb-ee7007969440 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008795 May 10 16:55:36.319055 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 426/822] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 10 16:55:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 16:55:36.326280 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-42b3e04f-9d3f-405a-93c7-07656c2694a4 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Calling method '.version_select at 0x7f5fb6aa01f0>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:36.353717 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-42b3e04f-9d3f-405a-93c7-07656c2694a4 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] HTTP exception thrown: Volume tempest-invalid-1911779154 could not be found. May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-42b3e04f-9d3f-405a-93c7-07656c2694a4 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Request method failure captured: May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1911779154 HTTP/1.1 May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepkIchTd944RdxhWWoQITkz7ItIyJRXyvqiASl6xFzro_-CKdOajRmt4-sCG75cDm2tT0KJHAJF3BYes40VtNb9174cZrMSIZX8HCfL3fhhmACF8qNmSYImnCqhABE_IdWzPpLENq7TapQ0Rh6XZkLbDcYDLxeWri7iiRFOvgwwCpvs May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:55:36.356622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 4d1852e813a94512b41e0bae8cbc57d4 May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Volume tempest-invalid-1911779154 could not be found. May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': 'tempest-invalid-1911779154'} May 10 16:55:36.358933 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1911779154 could not be found. (HTTP 404) (Request-ID: req-b1a84021-d378-40af-b9f8-c8194d543e68) May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.360710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:55:36.363252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1911779154 could not be found. May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:55:36.366093 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1911779154 could not be found. May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1911779154 could not be found. May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-42b3e04f-9d3f-405a-93c7-07656c2694a4 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Returning 404 to user: Volume tempest-invalid-1911779154 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-42b3e04f-9d3f-405a-93c7-07656c2694a4 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1911779154" status: 404 len: 99 microversion: 2.1 time: 0.037110 May 10 16:55:36.368798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 397/823] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 10 16:55:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1911779154 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 16:55:36.372143 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-56a947bd-8b9b-492f-ba6d-4184a785c434 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006251 May 10 16:55:36.372871 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 427/824] 10.222.0.48 () {58 vars in 1139 bytes} [Tue May 10 16:55:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 16:55:36.381636 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3569668f-c6ac-46fa-9377-de29788e3fd5 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003634 May 10 16:55:36.382163 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 398/825] 10.222.0.48 () {58 vars in 1136 bytes} [Tue May 10 16:55:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 16:55:36.390945 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b4f31bc7-4420-4aea-9664-eb60d40592cb tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Calling method '.version_select at 0x7f5fb63a71f0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:36.418394 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-b4f31bc7-4420-4aea-9664-eb60d40592cb tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] HTTP exception thrown: Volume 77126769-d2a8-4670-afdb-c77861d2d337 could not be found. May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b4f31bc7-4420-4aea-9664-eb60d40592cb tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Request method failure captured: May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: DELETE /compute/v2.1/os-volumes/77126769-d2a8-4670-afdb-c77861d2d337 HTTP/1.1 May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepkIchTd944RdxhWWoQITkz7ItIyJRXyvqiASl6xFzro_-CKdOajRmt4-sCG75cDm2tT0KJHAJF3BYes40VtNb9174cZrMSIZX8HCfL3fhhmACF8qNmSYImnCqhABE_IdWzPpLENq7TapQ0Rh6XZkLbDcYDLxeWri7iiRFOvgwwCpvs May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:55:36.420870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 4d1852e813a94512b41e0bae8cbc57d4 May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Volume 77126769-d2a8-4670-afdb-c77861d2d337 could not be found. May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '77126769-d2a8-4670-afdb-c77861d2d337'} May 10 16:55:36.422382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77126769-d2a8-4670-afdb-c77861d2d337 could not be found. (HTTP 404) (Request-ID: req-54156202-7ca6-4111-8cf2-e2b03cb71bed) May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.423328 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:55:36.424983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77126769-d2a8-4670-afdb-c77861d2d337 could not be found. May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 16:55:36.426336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77126769-d2a8-4670-afdb-c77861d2d337 could not be found. May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77126769-d2a8-4670-afdb-c77861d2d337 could not be found. May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b4f31bc7-4420-4aea-9664-eb60d40592cb tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Returning 404 to user: Volume 77126769-d2a8-4670-afdb-c77861d2d337 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b4f31bc7-4420-4aea-9664-eb60d40592cb tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/77126769-d2a8-4670-afdb-c77861d2d337" status: 404 len: 109 microversion: 2.1 time: 0.035261 May 10 16:55:36.427880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 428/826] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 10 16:55:36 2022] DELETE /compute/v2.1/os-volumes/77126769-d2a8-4670-afdb-c77861d2d337 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:55:36.432103 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9a0ae1b2-214e-4b61-aa44-ec07a21e4384 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Calling method '.version_select at 0x7f5fb6a579d0>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:36.459352 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-9a0ae1b2-214e-4b61-aa44-ec07a21e4384 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] HTTP exception thrown: Volume b5b0fb68-3e7a-408c-826c-e42b1a76425e could not be found. May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9a0ae1b2-214e-4b61-aa44-ec07a21e4384 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Request method failure captured: May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/os-volumes/b5b0fb68-3e7a-408c-826c-e42b1a76425e HTTP/1.1 May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepkIchTd944RdxhWWoQITkz7ItIyJRXyvqiASl6xFzro_-CKdOajRmt4-sCG75cDm2tT0KJHAJF3BYes40VtNb9174cZrMSIZX8HCfL3fhhmACF8qNmSYImnCqhABE_IdWzPpLENq7TapQ0Rh6XZkLbDcYDLxeWri7iiRFOvgwwCpvs May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:55:36.463970 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c89b254235214dd9b03b15dc50e3960c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: c89b254235214dd9b03b15dc50e3960c May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-VolumesNegativeTest-1408492872 May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 4d1852e813a94512b41e0bae8cbc57d4 May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-VolumesNegativeTest-1408492872-project May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Volume b5b0fb68-3e7a-408c-826c-e42b1a76425e could not be found. May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': 'b5b0fb68-3e7a-408c-826c-e42b1a76425e'} May 10 16:55:36.466273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5b0fb68-3e7a-408c-826c-e42b1a76425e could not be found. (HTTP 404) (Request-ID: req-2f22dfd1-7f7a-4a53-892b-89bd798944e3) May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.467257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:55:36.468871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5b0fb68-3e7a-408c-826c-e42b1a76425e could not be found. May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 16:55:36.471144 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5b0fb68-3e7a-408c-826c-e42b1a76425e could not be found. May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5b0fb68-3e7a-408c-826c-e42b1a76425e could not be found. May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9a0ae1b2-214e-4b61-aa44-ec07a21e4384 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] Returning 404 to user: Volume b5b0fb68-3e7a-408c-826c-e42b1a76425e could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:55:36.472580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9a0ae1b2-214e-4b61-aa44-ec07a21e4384 tempest-VolumesNegativeTest-1408492872 tempest-VolumesNegativeTest-1408492872-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b5b0fb68-3e7a-408c-826c-e42b1a76425e" status: 404 len: 109 microversion: 2.1 time: 0.038176 May 10 16:55:36.476193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 399/827] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:55:36 2022] GET /compute/v2.1/os-volumes/b5b0fb68-3e7a-408c-826c-e42b1a76425e => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:55:36.739705 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2c9426fc-beaf-4d5e-9201-07f617b350a9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:36.740609 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2c9426fc-beaf-4d5e-9201-07f617b350a9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:36.747555 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2c9426fc-beaf-4d5e-9201-07f617b350a9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:36.748244 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2c9426fc-beaf-4d5e-9201-07f617b350a9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:36.749229 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2c9426fc-beaf-4d5e-9201-07f617b350a9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:36.749819 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2c9426fc-beaf-4d5e-9201-07f617b350a9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:36.843941 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2c9426fc-beaf-4d5e-9201-07f617b350a9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:36.851602 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2c9426fc-beaf-4d5e-9201-07f617b350a9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1210 microversion: 2.1 time: 0.116282 May 10 16:55:36.852646 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 429/828] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:36 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:37.879024 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9bbdbe82-b03e-40af-9c89-1890f5bb272f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:37.879641 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9bbdbe82-b03e-40af-9c89-1890f5bb272f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:37.887375 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9bbdbe82-b03e-40af-9c89-1890f5bb272f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:37.887855 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9bbdbe82-b03e-40af-9c89-1890f5bb272f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:37.888678 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9bbdbe82-b03e-40af-9c89-1890f5bb272f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:37.889119 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9bbdbe82-b03e-40af-9c89-1890f5bb272f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:38.044932 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9bbdbe82-b03e-40af-9c89-1890f5bb272f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:38.053896 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9bbdbe82-b03e-40af-9c89-1890f5bb272f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1278 microversion: 2.1 time: 0.179155 May 10 16:55:38.055836 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 400/829] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:37 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:38.200199 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-28cbe27f-0c48-4c71-897e-d9cf744d4f93 req-da1d7b96-4f2e-4e2e-a1a8-6ba51a528e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d3be1d-f8ff-4768-950e-8cc38569d771", "tag": "7509683f-2476-48cf-bc4c-a50c8e6f5603"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:38.214271 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-28cbe27f-0c48-4c71-897e-d9cf744d4f93 req-da1d7b96-4f2e-4e2e-a1a8-6ba51a528e42 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:38.215124 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-28cbe27f-0c48-4c71-897e-d9cf744d4f93 req-da1d7b96-4f2e-4e2e-a1a8-6ba51a528e42 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:38.238834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-28cbe27f-0c48-4c71-897e-d9cf744d4f93 req-da1d7b96-4f2e-4e2e-a1a8-6ba51a528e42 service nova] Creating event network-changed:7509683f-2476-48cf-bc4c-a50c8e6f5603 for instance 00d3be1d-f8ff-4768-950e-8cc38569d771 on hv-cinder-83588 May 10 16:55:38.242814 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-28cbe27f-0c48-4c71-897e-d9cf744d4f93 req-da1d7b96-4f2e-4e2e-a1a8-6ba51a528e42 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048156 May 10 16:55:38.243561 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 430/830] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:38.694060 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-65bda052-59c5-40e4-9b8c-4c6347e342bf tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: .version_select at 0x7f5fb6afba60>, body: {"keypair": {"name": "tempest-keypair-1029536141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEhWcBq2eKmq6hh2AdghX37ktOKeATSEtU5eSnGoR1Ax7W5ZrcO67Kms3OS6iX40h0AmkiMaagvA3Gd/fdnWJUfzNdbPciH6nqI1jM+yjbh1jajBqeyGpmHQLPVi7N9yQ=="}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:38.711221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-65bda052-59c5-40e4-9b8c-4c6347e342bf tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:55:38.719026 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-65bda052-59c5-40e4-9b8c-4c6347e342bf tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for user 69585611ca7547adb43378445b4f1521 and project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:55:38.743697 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-65bda052-59c5-40e4-9b8c-4c6347e342bf tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054709 May 10 16:55:38.744626 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 401/831] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 10 16:55:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:39.075270 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2c7f5b9c-4d11-445e-86de-bf29619b57cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:39.075900 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2c7f5b9c-4d11-445e-86de-bf29619b57cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:39.097375 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2c7f5b9c-4d11-445e-86de-bf29619b57cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:39.097827 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2c7f5b9c-4d11-445e-86de-bf29619b57cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:39.098644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2c7f5b9c-4d11-445e-86de-bf29619b57cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:39.103045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2c7f5b9c-4d11-445e-86de-bf29619b57cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:39.398953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2c7f5b9c-4d11-445e-86de-bf29619b57cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:39.407729 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2c7f5b9c-4d11-445e-86de-bf29619b57cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1266 microversion: 2.1 time: 0.337918 May 10 16:55:39.408516 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 431/832] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:39 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:40.428958 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-72b7050e-664a-41af-be2b-77b24f352ed5 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:40.429882 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-72b7050e-664a-41af-be2b-77b24f352ed5 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:40.439054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-72b7050e-664a-41af-be2b-77b24f352ed5 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:40.439899 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-72b7050e-664a-41af-be2b-77b24f352ed5 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:40.441022 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-72b7050e-664a-41af-be2b-77b24f352ed5 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:40.441622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-72b7050e-664a-41af-be2b-77b24f352ed5 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:40.604230 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-72b7050e-664a-41af-be2b-77b24f352ed5 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:40.605985 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-879755475", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46307fca-4b0a-4fde-a0d0-41f51f1065e5"}], "security_groups": [{"name": "tempest-securitygroup--482567107"}], "key_name": "tempest-keypair-1029536141", "user_data": "}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:40.613572 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-72b7050e-664a-41af-be2b-77b24f352ed5 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1266 microversion: 2.1 time: 0.190260 May 10 16:55:40.616549 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 402/833] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:40 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:40.714676 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.network.neutron [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] validate_networks() for [('46307fca-4b0a-4fde-a0d0-41f51f1065e5', None, None, None, None, None)] {{(pid=134195) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:55:41.128629 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Flavor limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:55:41.129058 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Image limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:55:41.130571 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Flavor pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:55:41.131020 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Image pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:55:41.131459 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:55:41.140606 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:41.141056 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:41.141867 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:41.142305 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:41.159953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:55:41.163842 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for user 69585611ca7547adb43378445b4f1521 and project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:55:41.176102 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Going to run 1 instances... {{(pid=134195) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:55:41.178426 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134195) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:55:41.226138 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3063a507-424f-43ba-ae93-ad829c57eafc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.626038 May 10 16:55:41.226790 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 432/834] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:55:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:55:41.237507 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-94a2666c-7a4e-4d10-ab5e-e0f7cf68b205 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:41.238252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-94a2666c-7a4e-4d10-ab5e-e0f7cf68b205 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:41.300294 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-94a2666c-7a4e-4d10-ab5e-e0f7cf68b205 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:41.308839 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-94a2666c-7a4e-4d10-ab5e-e0f7cf68b205 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1241 microversion: 2.1 time: 0.075064 May 10 16:55:41.316318 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 403/835] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:41 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:41.642085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c2408177-93db-4891-9345-8a0f3a6c1df4 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:41.642713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c2408177-93db-4891-9345-8a0f3a6c1df4 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:41.650843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c2408177-93db-4891-9345-8a0f3a6c1df4 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:41.651305 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c2408177-93db-4891-9345-8a0f3a6c1df4 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:41.652816 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c2408177-93db-4891-9345-8a0f3a6c1df4 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:41.653354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c2408177-93db-4891-9345-8a0f3a6c1df4 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:41.796520 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c2408177-93db-4891-9345-8a0f3a6c1df4 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:41.805805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c2408177-93db-4891-9345-8a0f3a6c1df4 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1266 microversion: 2.1 time: 0.167843 May 10 16:55:41.806611 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 433/836] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:41 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:42.325870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-957cb27e-d664-4836-b196-e18178e88deb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:42.326542 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-957cb27e-d664-4836-b196-e18178e88deb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:42.333532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-957cb27e-d664-4836-b196-e18178e88deb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:42.333986 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-957cb27e-d664-4836-b196-e18178e88deb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:42.334752 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-957cb27e-d664-4836-b196-e18178e88deb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:42.335187 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-957cb27e-d664-4836-b196-e18178e88deb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:42.396210 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-957cb27e-d664-4836-b196-e18178e88deb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:42.404067 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-957cb27e-d664-4836-b196-e18178e88deb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1299 microversion: 2.1 time: 0.082258 May 10 16:55:42.404681 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 404/837] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:42 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:42.823065 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c9fdd470-3ace-4241-89ec-c293aa4a931e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:42.824085 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c9fdd470-3ace-4241-89ec-c293aa4a931e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:42.830572 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c9fdd470-3ace-4241-89ec-c293aa4a931e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:42.831031 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c9fdd470-3ace-4241-89ec-c293aa4a931e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:42.831806 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c9fdd470-3ace-4241-89ec-c293aa4a931e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:42.832254 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c9fdd470-3ace-4241-89ec-c293aa4a931e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:42.961980 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c9fdd470-3ace-4241-89ec-c293aa4a931e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:42.970452 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c9fdd470-3ace-4241-89ec-c293aa4a931e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1266 microversion: 2.1 time: 0.151326 May 10 16:55:42.971023 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 434/838] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:42 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:43.422349 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2c9c6d5e-8fd8-45ee-a79b-d0e3c726322e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:43.422965 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2c9c6d5e-8fd8-45ee-a79b-d0e3c726322e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:43.429717 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2c9c6d5e-8fd8-45ee-a79b-d0e3c726322e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:43.430120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2c9c6d5e-8fd8-45ee-a79b-d0e3c726322e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:43.430891 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2c9c6d5e-8fd8-45ee-a79b-d0e3c726322e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:43.431332 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2c9c6d5e-8fd8-45ee-a79b-d0e3c726322e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:43.491896 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2c9c6d5e-8fd8-45ee-a79b-d0e3c726322e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:43.500039 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2c9c6d5e-8fd8-45ee-a79b-d0e3c726322e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1299 microversion: 2.1 time: 0.081564 May 10 16:55:43.500652 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 405/839] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:43 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:43.988711 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2a72c408-c289-4073-8bec-94d84ac34da2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:43.989601 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2a72c408-c289-4073-8bec-94d84ac34da2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:43.997016 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2a72c408-c289-4073-8bec-94d84ac34da2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:43.997476 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2a72c408-c289-4073-8bec-94d84ac34da2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:43.998259 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2a72c408-c289-4073-8bec-94d84ac34da2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:43.998700 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2a72c408-c289-4073-8bec-94d84ac34da2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:44.133632 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2a72c408-c289-4073-8bec-94d84ac34da2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:44.142073 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2a72c408-c289-4073-8bec-94d84ac34da2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1266 microversion: 2.1 time: 0.158637 May 10 16:55:44.142643 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 435/840] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:43 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:44.517158 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ac4c3334-db62-4d9c-a161-c7be480a557c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:44.517721 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ac4c3334-db62-4d9c-a161-c7be480a557c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:44.524023 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ac4c3334-db62-4d9c-a161-c7be480a557c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:44.524513 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ac4c3334-db62-4d9c-a161-c7be480a557c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:44.525283 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ac4c3334-db62-4d9c-a161-c7be480a557c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:44.525722 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ac4c3334-db62-4d9c-a161-c7be480a557c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:44.589805 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ac4c3334-db62-4d9c-a161-c7be480a557c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:44.597182 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ac4c3334-db62-4d9c-a161-c7be480a557c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1299 microversion: 2.1 time: 0.083994 May 10 16:55:44.597753 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 406/841] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:44 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:45.158757 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-de8e8d94-bd99-4c45-915e-0340a61dfdce tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:45.159359 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-de8e8d94-bd99-4c45-915e-0340a61dfdce tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:45.165880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-de8e8d94-bd99-4c45-915e-0340a61dfdce tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:45.166412 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-de8e8d94-bd99-4c45-915e-0340a61dfdce tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:45.167884 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-de8e8d94-bd99-4c45-915e-0340a61dfdce tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:45.168440 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-de8e8d94-bd99-4c45-915e-0340a61dfdce tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:45.355282 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-de8e8d94-bd99-4c45-915e-0340a61dfdce tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:45.362981 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-de8e8d94-bd99-4c45-915e-0340a61dfdce tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1266 microversion: 2.1 time: 0.208203 May 10 16:55:45.363650 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 436/842] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:45 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:45.622800 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0783132a-2efe-4631-94c2-781bdc6ea9d1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:45.623995 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0783132a-2efe-4631-94c2-781bdc6ea9d1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:45.634809 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0783132a-2efe-4631-94c2-781bdc6ea9d1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:45.635284 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0783132a-2efe-4631-94c2-781bdc6ea9d1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:45.636101 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0783132a-2efe-4631-94c2-781bdc6ea9d1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:45.636561 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0783132a-2efe-4631-94c2-781bdc6ea9d1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:45.790613 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0783132a-2efe-4631-94c2-781bdc6ea9d1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:45.799421 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0783132a-2efe-4631-94c2-781bdc6ea9d1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1366 microversion: 2.1 time: 0.188884 May 10 16:55:45.800336 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 407/843] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:45 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:46.210176 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-fbc7bd00-8539-4111-834d-5148cf75e894 req-c7fa08d1-f9fd-437c-afc0-02fefe14782c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d50ae65-a922-42f2-8db1-87b59ed66282", "tag": "1638747b-dde0-47a8-a377-5887175304f1"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:46.222239 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-fbc7bd00-8539-4111-834d-5148cf75e894 req-c7fa08d1-f9fd-437c-afc0-02fefe14782c service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:46.222687 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-fbc7bd00-8539-4111-834d-5148cf75e894 req-c7fa08d1-f9fd-437c-afc0-02fefe14782c service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:46.235282 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-fbc7bd00-8539-4111-834d-5148cf75e894 req-c7fa08d1-f9fd-437c-afc0-02fefe14782c service nova] Creating event network-changed:1638747b-dde0-47a8-a377-5887175304f1 for instance 5d50ae65-a922-42f2-8db1-87b59ed66282 on hv-cinder-83588 May 10 16:55:46.240463 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-fbc7bd00-8539-4111-834d-5148cf75e894 req-c7fa08d1-f9fd-437c-afc0-02fefe14782c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033930 May 10 16:55:46.241638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 437/844] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:46.380792 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0cb0ee17-5661-472c-9c4c-bc22b492ac6f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:46.381488 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0cb0ee17-5661-472c-9c4c-bc22b492ac6f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:46.387719 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0cb0ee17-5661-472c-9c4c-bc22b492ac6f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:46.388246 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0cb0ee17-5661-472c-9c4c-bc22b492ac6f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:46.389116 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0cb0ee17-5661-472c-9c4c-bc22b492ac6f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:46.389560 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0cb0ee17-5661-472c-9c4c-bc22b492ac6f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:46.520014 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0cb0ee17-5661-472c-9c4c-bc22b492ac6f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:46.528156 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0cb0ee17-5661-472c-9c4c-bc22b492ac6f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1266 microversion: 2.1 time: 0.151305 May 10 16:55:46.528771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 408/845] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:46 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:46.815743 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-31e18df8-6212-47d4-9634-a511ada2aace tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:46.816473 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-31e18df8-6212-47d4-9634-a511ada2aace tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:46.822872 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-31e18df8-6212-47d4-9634-a511ada2aace tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:46.823417 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-31e18df8-6212-47d4-9634-a511ada2aace tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:46.824180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-31e18df8-6212-47d4-9634-a511ada2aace tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:46.824645 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-31e18df8-6212-47d4-9634-a511ada2aace tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:46.976866 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-31e18df8-6212-47d4-9634-a511ada2aace tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:46.985624 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-31e18df8-6212-47d4-9634-a511ada2aace tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1366 microversion: 2.1 time: 0.173962 May 10 16:55:46.988311 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 438/846] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:46 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:47.544385 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e4fd7687-b555-402b-a1cf-6f4de5d3b61e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:47.544972 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e4fd7687-b555-402b-a1cf-6f4de5d3b61e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:47.551562 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4fd7687-b555-402b-a1cf-6f4de5d3b61e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:47.552020 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4fd7687-b555-402b-a1cf-6f4de5d3b61e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:47.552835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4fd7687-b555-402b-a1cf-6f4de5d3b61e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:47.553291 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e4fd7687-b555-402b-a1cf-6f4de5d3b61e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:47.689729 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e4fd7687-b555-402b-a1cf-6f4de5d3b61e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:47.697109 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e4fd7687-b555-402b-a1cf-6f4de5d3b61e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1266 microversion: 2.1 time: 0.156842 May 10 16:55:47.697688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 409/847] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:47 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:48.003151 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2ec6f358-86fc-4669-bd37-7a74e7722d3a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:48.003768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2ec6f358-86fc-4669-bd37-7a74e7722d3a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:48.010139 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2ec6f358-86fc-4669-bd37-7a74e7722d3a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:48.011317 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2ec6f358-86fc-4669-bd37-7a74e7722d3a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:48.013501 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2ec6f358-86fc-4669-bd37-7a74e7722d3a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:48.013501 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2ec6f358-86fc-4669-bd37-7a74e7722d3a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:48.153147 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-2ec6f358-86fc-4669-bd37-7a74e7722d3a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:48.161120 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2ec6f358-86fc-4669-bd37-7a74e7722d3a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1366 microversion: 2.1 time: 0.161783 May 10 16:55:48.161692 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 439/848] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:47 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:48.713730 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-84c50966-8847-4f89-a778-567ac003aef0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:48.714675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-84c50966-8847-4f89-a778-567ac003aef0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:48.720899 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-84c50966-8847-4f89-a778-567ac003aef0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:48.721358 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-84c50966-8847-4f89-a778-567ac003aef0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:48.722141 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-84c50966-8847-4f89-a778-567ac003aef0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:48.722583 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-84c50966-8847-4f89-a778-567ac003aef0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:48.893783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-84c50966-8847-4f89-a778-567ac003aef0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:48.906005 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-84c50966-8847-4f89-a778-567ac003aef0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1266 microversion: 2.1 time: 0.196076 May 10 16:55:48.916077 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 410/849] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:48 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:49.180970 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-fc246c93-1f26-4b33-bf14-bc49606ebc23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:49.182173 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-fc246c93-1f26-4b33-bf14-bc49606ebc23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:49.189593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc246c93-1f26-4b33-bf14-bc49606ebc23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:49.190527 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc246c93-1f26-4b33-bf14-bc49606ebc23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:49.191412 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc246c93-1f26-4b33-bf14-bc49606ebc23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:49.191966 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc246c93-1f26-4b33-bf14-bc49606ebc23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:49.227125 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-f45343fe-cc01-411a-96e3-2e3ba70b60f6 req-8af1eb03-4f13-4a68-a6ca-9db7b9728ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d3be1d-f8ff-4768-950e-8cc38569d771", "name": "network-vif-plugged", "status": "completed", "tag": "7509683f-2476-48cf-bc4c-a50c8e6f5603"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:49.240737 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-f45343fe-cc01-411a-96e3-2e3ba70b60f6 req-8af1eb03-4f13-4a68-a6ca-9db7b9728ddd service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:49.242233 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-f45343fe-cc01-411a-96e3-2e3ba70b60f6 req-8af1eb03-4f13-4a68-a6ca-9db7b9728ddd service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:49.258706 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-f45343fe-cc01-411a-96e3-2e3ba70b60f6 req-8af1eb03-4f13-4a68-a6ca-9db7b9728ddd service nova] Creating event network-vif-plugged:7509683f-2476-48cf-bc4c-a50c8e6f5603 for instance 00d3be1d-f8ff-4768-950e-8cc38569d771 on hv-cinder-83588 May 10 16:55:49.265264 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-f45343fe-cc01-411a-96e3-2e3ba70b60f6 req-8af1eb03-4f13-4a68-a6ca-9db7b9728ddd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043841 May 10 16:55:49.266803 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 411/850] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:49.359221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-fc246c93-1f26-4b33-bf14-bc49606ebc23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:49.373177 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-fc246c93-1f26-4b33-bf14-bc49606ebc23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1366 microversion: 2.1 time: 0.195881 May 10 16:55:49.374540 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 440/851] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:49 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:55:49.924425 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cfad8360-35c4-4518-b91a-0454f5b85beb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:49.925103 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cfad8360-35c4-4518-b91a-0454f5b85beb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:49.931124 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cfad8360-35c4-4518-b91a-0454f5b85beb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:49.931580 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cfad8360-35c4-4518-b91a-0454f5b85beb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:49.932391 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cfad8360-35c4-4518-b91a-0454f5b85beb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:49.932923 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cfad8360-35c4-4518-b91a-0454f5b85beb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:50.065209 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cfad8360-35c4-4518-b91a-0454f5b85beb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:50.072473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cfad8360-35c4-4518-b91a-0454f5b85beb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1266 microversion: 2.1 time: 0.153259 May 10 16:55:50.073651 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 412/852] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:49 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:50.390789 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-741aab6c-2094-4c27-903d-0524efd63269 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:50.391425 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-741aab6c-2094-4c27-903d-0524efd63269 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:50.397816 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-741aab6c-2094-4c27-903d-0524efd63269 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:50.398276 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-741aab6c-2094-4c27-903d-0524efd63269 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:50.399459 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-741aab6c-2094-4c27-903d-0524efd63269 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:50.400168 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-741aab6c-2094-4c27-903d-0524efd63269 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:50.545107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-741aab6c-2094-4c27-903d-0524efd63269 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:50.552761 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-741aab6c-2094-4c27-903d-0524efd63269 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1366 microversion: 2.1 time: 0.165740 May 10 16:55:50.553337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 441/853] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:50 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:55:51.090839 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2b8b79ea-a77d-4eb1-a0f7-89f904426a4e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:51.092130 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2b8b79ea-a77d-4eb1-a0f7-89f904426a4e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:51.098972 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2b8b79ea-a77d-4eb1-a0f7-89f904426a4e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:51.099766 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2b8b79ea-a77d-4eb1-a0f7-89f904426a4e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:51.100963 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2b8b79ea-a77d-4eb1-a0f7-89f904426a4e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:51.101392 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2b8b79ea-a77d-4eb1-a0f7-89f904426a4e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:51.234356 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2b8b79ea-a77d-4eb1-a0f7-89f904426a4e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:51.241843 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2b8b79ea-a77d-4eb1-a0f7-89f904426a4e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1452 microversion: 2.1 time: 0.156166 May 10 16:55:51.242497 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 413/854] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:51 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:51.259520 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f230dba5-127b-4870-a2f8-01672e1b8616 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:51.260200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f230dba5-127b-4870-a2f8-01672e1b8616 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:51.266537 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f230dba5-127b-4870-a2f8-01672e1b8616 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:51.266993 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f230dba5-127b-4870-a2f8-01672e1b8616 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:51.267772 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f230dba5-127b-4870-a2f8-01672e1b8616 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:51.268209 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f230dba5-127b-4870-a2f8-01672e1b8616 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:51.285759 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-78fa5dcb-a124-4bc4-8c00-284b5003b57c req-33286c6a-1d6e-4dbc-9d17-23ed035b36c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d50ae65-a922-42f2-8db1-87b59ed66282", "name": "network-vif-plugged", "status": "completed", "tag": "1638747b-dde0-47a8-a377-5887175304f1"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:51.294318 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-78fa5dcb-a124-4bc4-8c00-284b5003b57c req-33286c6a-1d6e-4dbc-9d17-23ed035b36c9 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:51.294762 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-78fa5dcb-a124-4bc4-8c00-284b5003b57c req-33286c6a-1d6e-4dbc-9d17-23ed035b36c9 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:51.306792 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-78fa5dcb-a124-4bc4-8c00-284b5003b57c req-33286c6a-1d6e-4dbc-9d17-23ed035b36c9 service nova] Creating event network-vif-plugged:1638747b-dde0-47a8-a377-5887175304f1 for instance 5d50ae65-a922-42f2-8db1-87b59ed66282 on hv-cinder-83588 May 10 16:55:51.315792 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-78fa5dcb-a124-4bc4-8c00-284b5003b57c req-33286c6a-1d6e-4dbc-9d17-23ed035b36c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 May 10 16:55:51.316429 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 414/855] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:55:51.425891 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f230dba5-127b-4870-a2f8-01672e1b8616 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:51.433936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f230dba5-127b-4870-a2f8-01672e1b8616 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1452 microversion: 2.1 time: 0.178309 May 10 16:55:51.434827 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 442/856] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:51 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:55:51.569997 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9b1d2db1-6da9-416c-8dee-a2e34a6b19b2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:51.570733 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9b1d2db1-6da9-416c-8dee-a2e34a6b19b2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:51.577434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9b1d2db1-6da9-416c-8dee-a2e34a6b19b2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:51.577884 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9b1d2db1-6da9-416c-8dee-a2e34a6b19b2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:51.578663 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9b1d2db1-6da9-416c-8dee-a2e34a6b19b2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:51.579309 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9b1d2db1-6da9-416c-8dee-a2e34a6b19b2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:51.755205 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-9b1d2db1-6da9-416c-8dee-a2e34a6b19b2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:51.763988 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9b1d2db1-6da9-416c-8dee-a2e34a6b19b2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1366 microversion: 2.1 time: 0.197918 May 10 16:55:51.764606 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 415/857] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:51 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:55:52.782539 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a059f530-b2ff-4a3b-b565-f2499ef8fe02 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:52.783156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a059f530-b2ff-4a3b-b565-f2499ef8fe02 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:52.789988 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a059f530-b2ff-4a3b-b565-f2499ef8fe02 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:52.790661 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a059f530-b2ff-4a3b-b565-f2499ef8fe02 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:52.791450 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a059f530-b2ff-4a3b-b565-f2499ef8fe02 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:52.792424 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a059f530-b2ff-4a3b-b565-f2499ef8fe02 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:52.978144 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a059f530-b2ff-4a3b-b565-f2499ef8fe02 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:55:52.985969 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a059f530-b2ff-4a3b-b565-f2499ef8fe02 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1556 microversion: 2.1 time: 0.208664 May 10 16:55:52.986538 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 443/858] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:55:52 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1556 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:55:53.002292 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-613918a9-143b-4238-866b-49945c3be1f1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:55:53.003631 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-613918a9-143b-4238-866b-49945c3be1f1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:55:53.010885 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-613918a9-143b-4238-866b-49945c3be1f1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:53.011539 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-613918a9-143b-4238-866b-49945c3be1f1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:53.012635 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-613918a9-143b-4238-866b-49945c3be1f1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:53.013078 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-613918a9-143b-4238-866b-49945c3be1f1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:53.123623 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-613918a9-143b-4238-866b-49945c3be1f1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124314 May 10 16:55:53.124501 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 416/859] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 10 16:55:52 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:53.958963 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-1de72318-61f6-48b8-b805-d2f0d58b55a7 req-607edcd4-3db6-4be5-8f7c-c7d695a395f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d3be1d-f8ff-4768-950e-8cc38569d771", "tag": "7509683f-2476-48cf-bc4c-a50c8e6f5603"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:53.968982 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-1de72318-61f6-48b8-b805-d2f0d58b55a7 req-607edcd4-3db6-4be5-8f7c-c7d695a395f8 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:53.969571 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-1de72318-61f6-48b8-b805-d2f0d58b55a7 req-607edcd4-3db6-4be5-8f7c-c7d695a395f8 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:53.982786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-1de72318-61f6-48b8-b805-d2f0d58b55a7 req-607edcd4-3db6-4be5-8f7c-c7d695a395f8 service nova] Creating event network-changed:7509683f-2476-48cf-bc4c-a50c8e6f5603 for instance 00d3be1d-f8ff-4768-950e-8cc38569d771 on hv-cinder-83588 May 10 16:55:53.988874 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-1de72318-61f6-48b8-b805-d2f0d58b55a7 req-607edcd4-3db6-4be5-8f7c-c7d695a395f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213234 May 10 16:55:53.989845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 444/860] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:55:54.694563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-92f1d544-7c0a-4eaf-a88b-d4573fd290ac req-56fb2878-2f9c-45ba-9b52-a1cb6a87dec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d50ae65-a922-42f2-8db1-87b59ed66282", "tag": "1638747b-dde0-47a8-a377-5887175304f1"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:55:54.725140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-92f1d544-7c0a-4eaf-a88b-d4573fd290ac req-56fb2878-2f9c-45ba-9b52-a1cb6a87dec7 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:55:54.733476 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-92f1d544-7c0a-4eaf-a88b-d4573fd290ac req-56fb2878-2f9c-45ba-9b52-a1cb6a87dec7 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:55:54.762124 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-92f1d544-7c0a-4eaf-a88b-d4573fd290ac req-56fb2878-2f9c-45ba-9b52-a1cb6a87dec7 service nova] Creating event network-changed:1638747b-dde0-47a8-a377-5887175304f1 for instance 5d50ae65-a922-42f2-8db1-87b59ed66282 on hv-cinder-83588 May 10 16:55:54.768675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-92f1d544-7c0a-4eaf-a88b-d4573fd290ac req-56fb2878-2f9c-45ba-9b52-a1cb6a87dec7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079238 May 10 16:55:54.770111 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 417/861] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:56:30.916200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-675fa404-49ad-46ff-8d8f-ef2701e2eec6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:30.917102 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-675fa404-49ad-46ff-8d8f-ef2701e2eec6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:30.928303 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-675fa404-49ad-46ff-8d8f-ef2701e2eec6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:30.929094 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-675fa404-49ad-46ff-8d8f-ef2701e2eec6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:30.930417 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-675fa404-49ad-46ff-8d8f-ef2701e2eec6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:30.931719 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-675fa404-49ad-46ff-8d8f-ef2701e2eec6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:30.957345 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-675fa404-49ad-46ff-8d8f-ef2701e2eec6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282/ips" status: 200 len: 150 microversion: 2.1 time: 0.046338 May 10 16:56:30.957965 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 445/862] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 10 16:56:30 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:56:30.969171 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d227f4e2-bee9-41b6-aabc-2b8cebf308b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea150517-4d6f-4ba3-8456-03e639506e42"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:56:30.970785 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d227f4e2-bee9-41b6-aabc-2b8cebf308b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:30.977581 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d227f4e2-bee9-41b6-aabc-2b8cebf308b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:30.978712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d227f4e2-bee9-41b6-aabc-2b8cebf308b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:30.979569 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d227f4e2-bee9-41b6-aabc-2b8cebf308b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:30.980012 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d227f4e2-bee9-41b6-aabc-2b8cebf308b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:31.086438 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-d227f4e2-bee9-41b6-aabc-2b8cebf308b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Invalid volume: volume ea150517-4d6f-4ba3-8456-03e639506e42 is already attached to instances: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d227f4e2-bee9-41b6-aabc-2b8cebf308b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: POST /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282/os-volume_attachments HTTP/1.1 May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 74 May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:56:31.088783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {"volumeAttachment": {"volumeId": "ea150517-4d6f-4ba3-8456-03e639506e42"}} May 10 16:56:31.090454 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Invalid volume: volume ea150517-4d6f-4ba3-8456-03e639506e42 is already attached to instances: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'server_id': '5d50ae65-a922-42f2-8db1-87b59ed66282', 'body': {'volumeAttachment': {'volumeId': 'ea150517-4d6f-4ba3-8456-03e639506e42'}}} May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ea150517-4d6f-4ba3-8456-03e639506e42 is already attached to instances: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:31.091376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ea150517-4d6f-4ba3-8456-03e639506e42 is already attached to instances: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:56:31.092939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:56:31.094380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:56:31.094380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:56:31.094380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:56:31.094380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ea150517-4d6f-4ba3-8456-03e639506e42 is already attached to instances: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 May 10 16:56:31.094380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:31.094380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d227f4e2-bee9-41b6-aabc-2b8cebf308b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 400 to user: Invalid volume: volume ea150517-4d6f-4ba3-8456-03e639506e42 is already attached to instances: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:56:31.094380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d227f4e2-bee9-41b6-aabc-2b8cebf308b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125615 May 10 16:56:31.094380 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 418/863] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:56:30 2022] POST /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 16:56:31.101701 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-78132ccb-7d9f-4c73-873d-2b1d7690b6b9 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:31.102497 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-78132ccb-7d9f-4c73-873d-2b1d7690b6b9 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:31.111880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-78132ccb-7d9f-4c73-873d-2b1d7690b6b9 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:31.112609 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-78132ccb-7d9f-4c73-873d-2b1d7690b6b9 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:31.113798 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-78132ccb-7d9f-4c73-873d-2b1d7690b6b9 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:31.115264 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-78132ccb-7d9f-4c73-873d-2b1d7690b6b9 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:31.142777 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-78132ccb-7d9f-4c73-873d-2b1d7690b6b9 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Going to try to terminate instance {{(pid=134195) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:56:31.248080 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-78132ccb-7d9f-4c73-873d-2b1d7690b6b9 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 204 len: 0 microversion: 2.1 time: 0.151787 May 10 16:56:31.248080 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 446/864] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:56:31 2022] DELETE /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:56:31.259007 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-25e5bdee-cd13-4805-befc-908785d66a2a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:31.259755 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-25e5bdee-cd13-4805-befc-908785d66a2a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:31.266796 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-25e5bdee-cd13-4805-befc-908785d66a2a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:31.267246 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-25e5bdee-cd13-4805-befc-908785d66a2a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:31.268111 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-25e5bdee-cd13-4805-befc-908785d66a2a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:31.268579 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-25e5bdee-cd13-4805-befc-908785d66a2a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:31.419178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-25e5bdee-cd13-4805-befc-908785d66a2a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:31.429277 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-25e5bdee-cd13-4805-befc-908785d66a2a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1681 microversion: 2.1 time: 0.175200 May 10 16:56:31.430480 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 419/865] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:31 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:32.451008 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e8470b62-85c5-4082-a4f7-961df8c42a28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:32.451707 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e8470b62-85c5-4082-a4f7-961df8c42a28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:32.459107 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8470b62-85c5-4082-a4f7-961df8c42a28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:32.459812 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8470b62-85c5-4082-a4f7-961df8c42a28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:32.460813 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8470b62-85c5-4082-a4f7-961df8c42a28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:32.461530 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e8470b62-85c5-4082-a4f7-961df8c42a28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:32.642445 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e8470b62-85c5-4082-a4f7-961df8c42a28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:32.654609 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e8470b62-85c5-4082-a4f7-961df8c42a28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1681 microversion: 2.1 time: 0.207817 May 10 16:56:32.655573 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 447/866] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:32 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:56:33.675908 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8356f10f-de50-4545-87bc-f94db92ef406 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:33.677312 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8356f10f-de50-4545-87bc-f94db92ef406 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:33.686107 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8356f10f-de50-4545-87bc-f94db92ef406 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:33.686734 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8356f10f-de50-4545-87bc-f94db92ef406 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:33.687643 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8356f10f-de50-4545-87bc-f94db92ef406 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:33.688428 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8356f10f-de50-4545-87bc-f94db92ef406 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:33.780710 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-b81dde1e-8c27-4724-91ec-728807068c5b req-162add27-de6a-41ca-8fb0-525d5646fdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d50ae65-a922-42f2-8db1-87b59ed66282", "name": "network-vif-deleted", "tag": "1638747b-dde0-47a8-a377-5887175304f1"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:56:33.787979 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8356f10f-de50-4545-87bc-f94db92ef406 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:33.794030 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-b81dde1e-8c27-4724-91ec-728807068c5b req-162add27-de6a-41ca-8fb0-525d5646fdf5 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:33.794805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-b81dde1e-8c27-4724-91ec-728807068c5b req-162add27-de6a-41ca-8fb0-525d5646fdf5 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:33.800019 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8356f10f-de50-4545-87bc-f94db92ef406 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 200 len: 1614 microversion: 2.1 time: 0.127943 May 10 16:56:33.800389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 420/867] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:33 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 1614 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:56:33.808443 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-b81dde1e-8c27-4724-91ec-728807068c5b req-162add27-de6a-41ca-8fb0-525d5646fdf5 service nova] Creating event network-vif-deleted:1638747b-dde0-47a8-a377-5887175304f1 for instance 5d50ae65-a922-42f2-8db1-87b59ed66282 on hv-cinder-83588 May 10 16:56:33.813652 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-b81dde1e-8c27-4724-91ec-728807068c5b req-162add27-de6a-41ca-8fb0-525d5646fdf5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036498 May 10 16:56:33.814630 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 448/868] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:56:34.825199 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5b9c50c9-34ac-483d-ab01-58a3ca3e69e5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:34.825905 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5b9c50c9-34ac-483d-ab01-58a3ca3e69e5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:34.833329 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5b9c50c9-34ac-483d-ab01-58a3ca3e69e5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:34.833805 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5b9c50c9-34ac-483d-ab01-58a3ca3e69e5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:34.834590 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5b9c50c9-34ac-483d-ab01-58a3ca3e69e5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:34.835027 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5b9c50c9-34ac-483d-ab01-58a3ca3e69e5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:34.850139 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-5b9c50c9-34ac-483d-ab01-58a3ca3e69e5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5b9c50c9-34ac-483d-ab01-58a3ca3e69e5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 HTTP/1.1 May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:56:34.851708 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:56:34.855866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '5d50ae65-a922-42f2-8db1-87b59ed66282'} May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:56:34.857406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:56:34.859743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:34.861868 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5b9c50c9-34ac-483d-ab01-58a3ca3e69e5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:56:34.861868 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-5b9c50c9-34ac-483d-ab01-58a3ca3e69e5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 404 len: 111 microversion: 2.1 time: 0.032088 May 10 16:56:34.861868 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 421/869] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:34 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:56:34.870450 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ba02b246-1835-486b-a5f5-36b1667a46cd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '.version_select at 0x7f5fbfefb9d0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:34.893226 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ba02b246-1835-486b-a5f5-36b1667a46cd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029536141" status: 202 len: 0 microversion: 2.1 time: 0.030261 May 10 16:56:34.893834 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 449/870] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 10 16:56:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029536141 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 16:56:35.598217 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-18810c84-625e-4a8c-a392-f7ff415550cd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:35.598710 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-18810c84-625e-4a8c-a392-f7ff415550cd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:35.604909 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18810c84-625e-4a8c-a392-f7ff415550cd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:35.605373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18810c84-625e-4a8c-a392-f7ff415550cd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:35.606137 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18810c84-625e-4a8c-a392-f7ff415550cd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:35.606593 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-18810c84-625e-4a8c-a392-f7ff415550cd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:35.689705 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-18810c84-625e-4a8c-a392-f7ff415550cd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lazy-loading 'services' on Instance uuid 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:56:35.764022 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-18810c84-625e-4a8c-a392-f7ff415550cd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/os-volume_attachments/ea150517-4d6f-4ba3-8456-03e639506e42" status: 202 len: 0 microversion: 2.1 time: 0.169593 May 10 16:56:35.764776 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 422/871] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:56:35 2022] DELETE /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/os-volume_attachments/ea150517-4d6f-4ba3-8456-03e639506e42 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 16:56:35.773263 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-b5318909-efdf-446c-8d59-c762d6c9b475 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:35.774298 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-b5318909-efdf-446c-8d59-c762d6c9b475 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:35.781635 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5318909-efdf-446c-8d59-c762d6c9b475 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:35.782101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5318909-efdf-446c-8d59-c762d6c9b475 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:35.782863 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5318909-efdf-446c-8d59-c762d6c9b475 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:35.783293 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-b5318909-efdf-446c-8d59-c762d6c9b475 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:35.814279 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-b5318909-efdf-446c-8d59-c762d6c9b475 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 May 10 16:56:35.814978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 450/872] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:56:35 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:56:36.827796 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-969b6177-f310-4bf0-94fd-0fb15464b711 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:36.828978 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-969b6177-f310-4bf0-94fd-0fb15464b711 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:36.835249 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-969b6177-f310-4bf0-94fd-0fb15464b711 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:36.835699 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-969b6177-f310-4bf0-94fd-0fb15464b711 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:36.836518 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-969b6177-f310-4bf0-94fd-0fb15464b711 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:36.837005 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-969b6177-f310-4bf0-94fd-0fb15464b711 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:36.866625 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-969b6177-f310-4bf0-94fd-0fb15464b711 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043587 May 10 16:56:36.867182 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 423/873] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:56:36 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:56:36.929073 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-0806dcef-ffb7-469f-aa05-a3c097580b40 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:36.929626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0806dcef-ffb7-469f-aa05-a3c097580b40 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:36.936772 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0806dcef-ffb7-469f-aa05-a3c097580b40 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:36.937225 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0806dcef-ffb7-469f-aa05-a3c097580b40 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:36.938004 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0806dcef-ffb7-469f-aa05-a3c097580b40 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:36.938443 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-0806dcef-ffb7-469f-aa05-a3c097580b40 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:36.964772 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-0806dcef-ffb7-469f-aa05-a3c097580b40 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Going to try to terminate instance {{(pid=134195) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:56:37.042746 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-0806dcef-ffb7-469f-aa05-a3c097580b40 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 204 len: 0 microversion: 2.1 time: 0.117213 May 10 16:56:37.043481 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 451/874] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:56:36 2022] DELETE /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:56:37.052632 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c555d753-9651-40d7-8245-0cd3fd8cac48 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:37.053251 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c555d753-9651-40d7-8245-0cd3fd8cac48 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:37.059915 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c555d753-9651-40d7-8245-0cd3fd8cac48 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:37.060401 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c555d753-9651-40d7-8245-0cd3fd8cac48 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:37.061604 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c555d753-9651-40d7-8245-0cd3fd8cac48 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:37.062045 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c555d753-9651-40d7-8245-0cd3fd8cac48 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:37.202037 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c555d753-9651-40d7-8245-0cd3fd8cac48 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:37.209605 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c555d753-9651-40d7-8245-0cd3fd8cac48 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1681 microversion: 2.1 time: 0.161227 May 10 16:56:37.210174 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 424/875] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:37 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:38.229120 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-377db24f-0275-4d38-9a0c-dac5fadb1bd1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:38.229847 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-377db24f-0275-4d38-9a0c-dac5fadb1bd1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:38.236250 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-377db24f-0275-4d38-9a0c-dac5fadb1bd1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:38.236731 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-377db24f-0275-4d38-9a0c-dac5fadb1bd1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:38.237503 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-377db24f-0275-4d38-9a0c-dac5fadb1bd1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:38.237939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-377db24f-0275-4d38-9a0c-dac5fadb1bd1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:38.376419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-377db24f-0275-4d38-9a0c-dac5fadb1bd1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:38.385511 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-377db24f-0275-4d38-9a0c-dac5fadb1bd1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1681 microversion: 2.1 time: 0.161350 May 10 16:56:38.386095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 452/876] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:38 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:39.404288 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-61acf62f-6844-4db7-92f9-49a54c436fbd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:39.404917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-61acf62f-6844-4db7-92f9-49a54c436fbd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:39.411568 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-61acf62f-6844-4db7-92f9-49a54c436fbd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:39.412025 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-61acf62f-6844-4db7-92f9-49a54c436fbd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:39.412863 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-61acf62f-6844-4db7-92f9-49a54c436fbd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:39.413341 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-61acf62f-6844-4db7-92f9-49a54c436fbd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:39.476969 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-61acf62f-6844-4db7-92f9-49a54c436fbd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:39.489691 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-61acf62f-6844-4db7-92f9-49a54c436fbd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 200 len: 1613 microversion: 2.1 time: 0.089503 May 10 16:56:39.489691 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 425/877] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:39 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:39.529388 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-04f97541-0f71-4d5a-b340-eba0b4058756 req-14876524-6e0b-4e19-b4ed-c6a53a9e65d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94042c88-ecb2-484f-8a2c-df1d0ecae7a6", "name": "network-vif-deleted", "tag": "c2215c98-d2de-4899-bfa6-5f508d8a56aa"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:56:39.549391 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-04f97541-0f71-4d5a-b340-eba0b4058756 req-14876524-6e0b-4e19-b4ed-c6a53a9e65d5 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:39.549833 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-04f97541-0f71-4d5a-b340-eba0b4058756 req-14876524-6e0b-4e19-b4ed-c6a53a9e65d5 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:39.570785 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-04f97541-0f71-4d5a-b340-eba0b4058756 req-14876524-6e0b-4e19-b4ed-c6a53a9e65d5 service nova] Creating event network-vif-deleted:c2215c98-d2de-4899-bfa6-5f508d8a56aa for instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 on hv-cinder-83588 May 10 16:56:39.579022 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-04f97541-0f71-4d5a-b340-eba0b4058756 req-14876524-6e0b-4e19-b4ed-c6a53a9e65d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052781 May 10 16:56:39.588418 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 453/878] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:56:40.506912 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-642fd8ee-0fa2-4d73-9fcf-b5b6bf5c7d03 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:40.507546 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-642fd8ee-0fa2-4d73-9fcf-b5b6bf5c7d03 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:40.515303 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-642fd8ee-0fa2-4d73-9fcf-b5b6bf5c7d03 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:40.515763 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-642fd8ee-0fa2-4d73-9fcf-b5b6bf5c7d03 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:40.516585 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-642fd8ee-0fa2-4d73-9fcf-b5b6bf5c7d03 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:40.517029 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-642fd8ee-0fa2-4d73-9fcf-b5b6bf5c7d03 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:40.532785 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-642fd8ee-0fa2-4d73-9fcf-b5b6bf5c7d03 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-642fd8ee-0fa2-4d73-9fcf-b5b6bf5c7d03 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 HTTP/1.1 May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:56:40.534462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:56:40.535771 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '94042c88-ecb2-484f-8a2c-df1d0ecae7a6'} May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:56:40.536614 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:56:40.537799 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:56:40.540434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-642fd8ee-0fa2-4d73-9fcf-b5b6bf5c7d03 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:56:40.540434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-642fd8ee-0fa2-4d73-9fcf-b5b6bf5c7d03 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 404 len: 111 microversion: 2.1 time: 0.033021 May 10 16:56:40.540434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 426/879] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:40 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 16:56:40.545714 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d847d2c3-c04c-477e-9643-6c9d5ddcb2d4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '.version_select at 0x7f5fbfea05e0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:40.564582 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d847d2c3-c04c-477e-9643-6c9d5ddcb2d4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-387672031" status: 202 len: 0 microversion: 2.1 time: 0.023103 May 10 16:56:40.565274 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 454/880] 10.222.0.48 () {58 vars in 1217 bytes} [Tue May 10 16:56:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-387672031 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:56:41.239086 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c68dc16d-d602-45e4-ae2c-be7125dbf13c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: .version_select at 0x7f5fb6a06940>, body: {"keypair": {"name": "tempest-keypair-1167457296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0k+iu0rt1A+f6BjvojOecfbQyV6dcwxx9tmjPaO7HFTg6unEoxq4biNX1kRQ6EHiodyfduKAyf3rUdN1XbtLtyHh1to0/005035SGI6GJcy56GQIsOrkLNsQM+9cx7kg=="}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:56:41.252998 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-c68dc16d-d602-45e4-ae2c-be7125dbf13c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:56:41.256748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-c68dc16d-d602-45e4-ae2c-be7125dbf13c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for user 69585611ca7547adb43378445b4f1521 and project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:56:41.278922 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c68dc16d-d602-45e4-ae2c-be7125dbf13c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043826 May 10 16:56:41.279521 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 427/881] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 10 16:56:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:56:42.732127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-310233090", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46307fca-4b0a-4fde-a0d0-41f51f1065e5"}], "security_groups": [{"name": "tempest-securitygroup--1102381598"}], "key_name": "tempest-keypair-1167457296", "user_data": "}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:56:42.837986 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.network.neutron [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] validate_networks() for [('46307fca-4b0a-4fde-a0d0-41f51f1065e5', None, None, None, None, None)] {{(pid=134195) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:56:43.202507 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Flavor limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:56:43.203038 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Image limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:56:43.203801 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Flavor pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:56:43.204444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Image pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:56:43.204965 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:56:43.216089 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:43.216629 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:43.217490 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:43.218090 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:43.234797 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:56:43.238688 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for user 69585611ca7547adb43378445b4f1521 and project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:56:43.250586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Going to run 1 instances... {{(pid=134195) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:56:43.252956 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134195) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:56:43.300427 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f380fd51-ced9-484a-acdf-00731c77fc28 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.572966 May 10 16:56:43.300994 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 455/882] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:56:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:56:43.311619 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c2f6fcb4-3ca9-4ce2-a244-94b45adf1340 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:43.312241 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c2f6fcb4-3ca9-4ce2-a244-94b45adf1340 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:43.369873 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c2f6fcb4-3ca9-4ce2-a244-94b45adf1340 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:43.378281 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c2f6fcb4-3ca9-4ce2-a244-94b45adf1340 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1241 microversion: 2.1 time: 0.069997 May 10 16:56:43.379044 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 428/883] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:43 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:44.397082 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-532c00dd-ab22-4256-b2fc-e61920ac84b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:44.398410 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-532c00dd-ab22-4256-b2fc-e61920ac84b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:44.407100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-532c00dd-ab22-4256-b2fc-e61920ac84b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:44.407861 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-532c00dd-ab22-4256-b2fc-e61920ac84b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:44.408680 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-532c00dd-ab22-4256-b2fc-e61920ac84b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:44.409425 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-532c00dd-ab22-4256-b2fc-e61920ac84b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:44.479552 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-532c00dd-ab22-4256-b2fc-e61920ac84b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:44.487015 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-532c00dd-ab22-4256-b2fc-e61920ac84b3 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1299 microversion: 2.1 time: 0.093762 May 10 16:56:44.487592 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 456/884] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:44 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:56:45.504405 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-bb58e760-159c-4fb0-8bfa-3790debdf0ec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:45.505015 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-bb58e760-159c-4fb0-8bfa-3790debdf0ec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:45.512085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb58e760-159c-4fb0-8bfa-3790debdf0ec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:45.512557 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb58e760-159c-4fb0-8bfa-3790debdf0ec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:45.513330 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb58e760-159c-4fb0-8bfa-3790debdf0ec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:45.513758 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb58e760-159c-4fb0-8bfa-3790debdf0ec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:45.544444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-5ac0bd91-9bcc-4c86-8b0e-940503670b51 req-fea94198-5687-40bb-8661-b4892acdb03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c190231-eceb-49d6-a1e0-c8fff5d68042", "tag": "d6c551a1-cfcf-4264-9a81-f760d5f6e8ab"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:56:45.559861 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-5ac0bd91-9bcc-4c86-8b0e-940503670b51 req-fea94198-5687-40bb-8661-b4892acdb03c service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:45.560910 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-5ac0bd91-9bcc-4c86-8b0e-940503670b51 req-fea94198-5687-40bb-8661-b4892acdb03c service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:45.588342 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-5ac0bd91-9bcc-4c86-8b0e-940503670b51 req-fea94198-5687-40bb-8661-b4892acdb03c service nova] Creating event network-changed:d6c551a1-cfcf-4264-9a81-f760d5f6e8ab for instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 on hv-cinder-83588 May 10 16:56:45.604742 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-5ac0bd91-9bcc-4c86-8b0e-940503670b51 req-fea94198-5687-40bb-8661-b4892acdb03c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065597 May 10 16:56:45.605685 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 457/885] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:56:45.666857 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-bb58e760-159c-4fb0-8bfa-3790debdf0ec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:45.675246 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-bb58e760-159c-4fb0-8bfa-3790debdf0ec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1367 microversion: 2.1 time: 0.174621 May 10 16:56:45.685276 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 429/886] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:45 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:46.695380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4b724366-568b-44dc-86b5-1001f554a815 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:46.696791 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4b724366-568b-44dc-86b5-1001f554a815 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:46.703022 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4b724366-568b-44dc-86b5-1001f554a815 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:46.703467 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4b724366-568b-44dc-86b5-1001f554a815 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:46.704237 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4b724366-568b-44dc-86b5-1001f554a815 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:46.704694 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4b724366-568b-44dc-86b5-1001f554a815 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:46.901951 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4b724366-568b-44dc-86b5-1001f554a815 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:46.909234 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4b724366-568b-44dc-86b5-1001f554a815 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1367 microversion: 2.1 time: 0.219610 May 10 16:56:46.909807 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 458/887] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:46 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:47.926604 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7d72ef5b-84bf-46a6-9efb-a03d8bde8ce5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:47.927211 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7d72ef5b-84bf-46a6-9efb-a03d8bde8ce5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:47.933734 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7d72ef5b-84bf-46a6-9efb-a03d8bde8ce5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:47.934181 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7d72ef5b-84bf-46a6-9efb-a03d8bde8ce5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:47.934944 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7d72ef5b-84bf-46a6-9efb-a03d8bde8ce5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:47.935374 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7d72ef5b-84bf-46a6-9efb-a03d8bde8ce5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:48.069350 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-7d72ef5b-84bf-46a6-9efb-a03d8bde8ce5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:48.077396 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7d72ef5b-84bf-46a6-9efb-a03d8bde8ce5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1367 microversion: 2.1 time: 0.154920 May 10 16:56:48.077960 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 430/888] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:47 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:49.093945 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9ebfaafa-a806-4fe3-800a-abb467a104ba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:49.094549 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9ebfaafa-a806-4fe3-800a-abb467a104ba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:49.100983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9ebfaafa-a806-4fe3-800a-abb467a104ba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:49.101433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9ebfaafa-a806-4fe3-800a-abb467a104ba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:49.102333 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9ebfaafa-a806-4fe3-800a-abb467a104ba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:49.102895 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9ebfaafa-a806-4fe3-800a-abb467a104ba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:49.237836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9ebfaafa-a806-4fe3-800a-abb467a104ba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:49.245740 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9ebfaafa-a806-4fe3-800a-abb467a104ba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1367 microversion: 2.1 time: 0.155624 May 10 16:56:49.246315 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 459/889] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:49 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:50.262913 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0b6c8756-7811-41e3-b80d-4c4c5606fc3c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:50.263520 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0b6c8756-7811-41e3-b80d-4c4c5606fc3c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:50.269863 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0b6c8756-7811-41e3-b80d-4c4c5606fc3c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:50.270313 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0b6c8756-7811-41e3-b80d-4c4c5606fc3c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:50.271075 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0b6c8756-7811-41e3-b80d-4c4c5606fc3c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:50.271509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0b6c8756-7811-41e3-b80d-4c4c5606fc3c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:50.402415 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-0b6c8756-7811-41e3-b80d-4c4c5606fc3c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:50.409648 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0b6c8756-7811-41e3-b80d-4c4c5606fc3c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1367 microversion: 2.1 time: 0.151164 May 10 16:56:50.410208 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 431/890] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:50 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:51.416476 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-4b8d55fa-d611-45f9-af16-25fbd06bb71c req-03e06d63-40a4-42f8-b098-8f6773371dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c190231-eceb-49d6-a1e0-c8fff5d68042", "name": "network-vif-plugged", "status": "completed", "tag": "d6c551a1-cfcf-4264-9a81-f760d5f6e8ab"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:56:51.425499 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-4b8d55fa-d611-45f9-af16-25fbd06bb71c req-03e06d63-40a4-42f8-b098-8f6773371dd4 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:51.425952 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-4b8d55fa-d611-45f9-af16-25fbd06bb71c req-03e06d63-40a4-42f8-b098-8f6773371dd4 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:51.429273 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-fa7797df-0e56-43d5-a7d6-e3f687767159 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:51.429896 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-fa7797df-0e56-43d5-a7d6-e3f687767159 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:51.436147 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fa7797df-0e56-43d5-a7d6-e3f687767159 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:51.436687 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fa7797df-0e56-43d5-a7d6-e3f687767159 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:51.437494 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fa7797df-0e56-43d5-a7d6-e3f687767159 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:51.437935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-fa7797df-0e56-43d5-a7d6-e3f687767159 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:51.589050 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-fa7797df-0e56-43d5-a7d6-e3f687767159 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:51.595913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-4b8d55fa-d611-45f9-af16-25fbd06bb71c req-03e06d63-40a4-42f8-b098-8f6773371dd4 service nova] Creating event network-vif-plugged:d6c551a1-cfcf-4264-9a81-f760d5f6e8ab for instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 on hv-cinder-83588 May 10 16:56:51.596488 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-fa7797df-0e56-43d5-a7d6-e3f687767159 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1367 microversion: 2.1 time: 0.173576 May 10 16:56:51.597081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 432/891] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:51 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:56:51.600881 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-4b8d55fa-d611-45f9-af16-25fbd06bb71c req-03e06d63-40a4-42f8-b098-8f6773371dd4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188867 May 10 16:56:51.601464 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 460/892] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:56:52.613773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a5308f91-4586-4609-bddc-d88264a61877 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:52.614391 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a5308f91-4586-4609-bddc-d88264a61877 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:52.621621 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a5308f91-4586-4609-bddc-d88264a61877 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:52.622099 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a5308f91-4586-4609-bddc-d88264a61877 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:52.622858 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a5308f91-4586-4609-bddc-d88264a61877 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:52.623313 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a5308f91-4586-4609-bddc-d88264a61877 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:52.753463 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a5308f91-4586-4609-bddc-d88264a61877 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:52.762125 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a5308f91-4586-4609-bddc-d88264a61877 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1367 microversion: 2.1 time: 0.152124 May 10 16:56:52.763045 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 433/893] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:52 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:53.780049 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-fc0f0580-b131-4cc5-9abd-c6f9c2227fba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:53.780769 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-fc0f0580-b131-4cc5-9abd-c6f9c2227fba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:53.786972 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc0f0580-b131-4cc5-9abd-c6f9c2227fba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:53.787435 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc0f0580-b131-4cc5-9abd-c6f9c2227fba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:53.788230 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc0f0580-b131-4cc5-9abd-c6f9c2227fba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:53.788702 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-fc0f0580-b131-4cc5-9abd-c6f9c2227fba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:53.917762 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-fc0f0580-b131-4cc5-9abd-c6f9c2227fba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:56:53.925353 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-fc0f0580-b131-4cc5-9abd-c6f9c2227fba tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1558 microversion: 2.1 time: 0.150087 May 10 16:56:53.925913 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 461/894] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:56:53 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:56:53.941902 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0da2863c-1252-40b0-899d-534152589e80 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:56:53.942411 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-0da2863c-1252-40b0-899d-534152589e80 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:56:53.949110 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0da2863c-1252-40b0-899d-534152589e80 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:53.949568 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0da2863c-1252-40b0-899d-534152589e80 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:53.950346 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0da2863c-1252-40b0-899d-534152589e80 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:53.950793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-0da2863c-1252-40b0-899d-534152589e80 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:54.025199 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0da2863c-1252-40b0-899d-534152589e80 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087127 May 10 16:56:54.025802 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 434/895] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 10 16:56:53 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:56:55.287514 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-c09ff2ec-e5c5-4bfa-b084-9e252a6e3929 req-1c7abf19-e6bb-4ed8-a363-2709bddcc65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c190231-eceb-49d6-a1e0-c8fff5d68042", "tag": "d6c551a1-cfcf-4264-9a81-f760d5f6e8ab"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:56:55.296049 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-c09ff2ec-e5c5-4bfa-b084-9e252a6e3929 req-1c7abf19-e6bb-4ed8-a363-2709bddcc65d service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:56:55.296516 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-c09ff2ec-e5c5-4bfa-b084-9e252a6e3929 req-1c7abf19-e6bb-4ed8-a363-2709bddcc65d service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:56:55.308032 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-c09ff2ec-e5c5-4bfa-b084-9e252a6e3929 req-1c7abf19-e6bb-4ed8-a363-2709bddcc65d service nova] Creating event network-changed:d6c551a1-cfcf-4264-9a81-f760d5f6e8ab for instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 on hv-cinder-83588 May 10 16:56:55.313015 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-c09ff2ec-e5c5-4bfa-b084-9e252a6e3929 req-1c7abf19-e6bb-4ed8-a363-2709bddcc65d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029113 May 10 16:56:55.313785 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 462/896] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:29.107431 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-401081c0-e0b9-4121-b507-5ec73521223b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:29.108017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-401081c0-e0b9-4121-b507-5ec73521223b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:29.113965 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-401081c0-e0b9-4121-b507-5ec73521223b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:29.114417 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-401081c0-e0b9-4121-b507-5ec73521223b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:29.115219 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-401081c0-e0b9-4121-b507-5ec73521223b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:29.115657 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-401081c0-e0b9-4121-b507-5ec73521223b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:29.138649 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-401081c0-e0b9-4121-b507-5ec73521223b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/ips" status: 200 len: 150 microversion: 2.1 time: 0.036171 May 10 16:57:29.139201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 435/897] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 10 16:57:29 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:30.469300 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-18d040e4-118e-4047-af5d-9347e113d003 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e84bd74-5f46-4118-8b63-47cc08205094"}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:30.470447 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-18d040e4-118e-4047-af5d-9347e113d003 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:30.476489 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18d040e4-118e-4047-af5d-9347e113d003 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:30.476941 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18d040e4-118e-4047-af5d-9347e113d003 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:30.477707 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18d040e4-118e-4047-af5d-9347e113d003 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:30.478141 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-18d040e4-118e-4047-af5d-9347e113d003 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:30.708615 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-18d040e4-118e-4047-af5d-9347e113d003 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243484 May 10 16:57:30.709577 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 463/898] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:57:30 2022] POST /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:37.143767 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-63f4d28d-a65c-44f9-a30d-d683a0cff9cc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e84bd74-5f46-4118-8b63-47cc08205094"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:37.144854 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-63f4d28d-a65c-44f9-a30d-d683a0cff9cc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:37.151193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-63f4d28d-a65c-44f9-a30d-d683a0cff9cc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:37.151636 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-63f4d28d-a65c-44f9-a30d-d683a0cff9cc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:37.152421 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-63f4d28d-a65c-44f9-a30d-d683a0cff9cc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:37.152855 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-63f4d28d-a65c-44f9-a30d-d683a0cff9cc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:37.229054 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-63f4d28d-a65c-44f9-a30d-d683a0cff9cc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Invalid volume: volume 5e84bd74-5f46-4118-8b63-47cc08205094 is already attached to instances: 4c190231-eceb-49d6-a1e0-c8fff5d68042 May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-63f4d28d-a65c-44f9-a30d-d683a0cff9cc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: POST /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments HTTP/1.1 May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 74 May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:57:37.230688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {"volumeAttachment": {"volumeId": "5e84bd74-5f46-4118-8b63-47cc08205094"}} May 10 16:57:37.232413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Invalid volume: volume 5e84bd74-5f46-4118-8b63-47cc08205094 is already attached to instances: 4c190231-eceb-49d6-a1e0-c8fff5d68042 May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'server_id': '4c190231-eceb-49d6-a1e0-c8fff5d68042', 'body': {'volumeAttachment': {'volumeId': '5e84bd74-5f46-4118-8b63-47cc08205094'}}} May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5e84bd74-5f46-4118-8b63-47cc08205094 is already attached to instances: 4c190231-eceb-49d6-a1e0-c8fff5d68042 May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:57:37.234059 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5e84bd74-5f46-4118-8b63-47cc08205094 is already attached to instances: 4c190231-eceb-49d6-a1e0-c8fff5d68042 May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:57:37.235558 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:57:37.237395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:57:37.237395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:57:37.237395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:57:37.237395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5e84bd74-5f46-4118-8b63-47cc08205094 is already attached to instances: 4c190231-eceb-49d6-a1e0-c8fff5d68042 May 10 16:57:37.237395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:57:37.237395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-63f4d28d-a65c-44f9-a30d-d683a0cff9cc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 400 to user: Invalid volume: volume 5e84bd74-5f46-4118-8b63-47cc08205094 is already attached to instances: 4c190231-eceb-49d6-a1e0-c8fff5d68042 {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:57:37.237395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-63f4d28d-a65c-44f9-a30d-d683a0cff9cc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092356 May 10 16:57:37.237395 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 436/899] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:57:37 2022] POST /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 16:57:37.295126 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-96ad3c2c-5c43-45a2-b6e1-eaf8f2a50485 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:37.296111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-96ad3c2c-5c43-45a2-b6e1-eaf8f2a50485 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:37.303800 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-96ad3c2c-5c43-45a2-b6e1-eaf8f2a50485 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:37.304247 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-96ad3c2c-5c43-45a2-b6e1-eaf8f2a50485 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:37.305045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-96ad3c2c-5c43-45a2-b6e1-eaf8f2a50485 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:37.305675 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-96ad3c2c-5c43-45a2-b6e1-eaf8f2a50485 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:37.382774 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-96ad3c2c-5c43-45a2-b6e1-eaf8f2a50485 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lazy-loading 'services' on Instance uuid 4c190231-eceb-49d6-a1e0-c8fff5d68042 {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:57:37.452928 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-96ad3c2c-5c43-45a2-b6e1-eaf8f2a50485 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments/5e84bd74-5f46-4118-8b63-47cc08205094" status: 202 len: 0 microversion: 2.1 time: 0.164935 May 10 16:57:37.453502 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 464/900] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:57:37 2022] DELETE /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments/5e84bd74-5f46-4118-8b63-47cc08205094 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:57:37.461918 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ed094f4f-cd07-44d4-87d8-ec90c8cb945b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:37.462901 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ed094f4f-cd07-44d4-87d8-ec90c8cb945b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:37.469609 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ed094f4f-cd07-44d4-87d8-ec90c8cb945b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:37.470131 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ed094f4f-cd07-44d4-87d8-ec90c8cb945b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:37.471002 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ed094f4f-cd07-44d4-87d8-ec90c8cb945b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:37.471494 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ed094f4f-cd07-44d4-87d8-ec90c8cb945b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:37.503446 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ed094f4f-cd07-44d4-87d8-ec90c8cb945b tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045426 May 10 16:57:37.503998 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 437/901] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:57:37 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:38.515752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f9447436-f423-4290-9076-58a178bf1c7f tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:38.516847 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f9447436-f423-4290-9076-58a178bf1c7f tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:38.523394 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f9447436-f423-4290-9076-58a178bf1c7f tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:38.523880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f9447436-f423-4290-9076-58a178bf1c7f tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:38.524718 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f9447436-f423-4290-9076-58a178bf1c7f tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:38.525156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f9447436-f423-4290-9076-58a178bf1c7f tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:38.555299 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f9447436-f423-4290-9076-58a178bf1c7f tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044036 May 10 16:57:38.555857 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 465/902] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:57:38 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:57:38.613406 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-3cb5b913-623b-4e94-8d8c-ab54ca6c3fa6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:38.613910 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3cb5b913-623b-4e94-8d8c-ab54ca6c3fa6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:38.623290 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3cb5b913-623b-4e94-8d8c-ab54ca6c3fa6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:38.623778 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3cb5b913-623b-4e94-8d8c-ab54ca6c3fa6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:38.624581 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3cb5b913-623b-4e94-8d8c-ab54ca6c3fa6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:38.625020 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-3cb5b913-623b-4e94-8d8c-ab54ca6c3fa6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:38.649894 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-3cb5b913-623b-4e94-8d8c-ab54ca6c3fa6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:57:38.727602 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-3cb5b913-623b-4e94-8d8c-ab54ca6c3fa6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 204 len: 0 microversion: 2.1 time: 0.117440 May 10 16:57:38.728413 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 438/903] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:57:38 2022] DELETE /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:57:38.737426 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-45afecee-68b4-447c-b3e6-eaae8e3f5755 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:38.738024 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-45afecee-68b4-447c-b3e6-eaae8e3f5755 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:38.750193 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-45afecee-68b4-447c-b3e6-eaae8e3f5755 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:38.750649 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-45afecee-68b4-447c-b3e6-eaae8e3f5755 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:38.751427 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-45afecee-68b4-447c-b3e6-eaae8e3f5755 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:38.751867 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-45afecee-68b4-447c-b3e6-eaae8e3f5755 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:38.887087 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-45afecee-68b4-447c-b3e6-eaae8e3f5755 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:38.895279 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-45afecee-68b4-447c-b3e6-eaae8e3f5755 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1682 microversion: 2.1 time: 0.161671 May 10 16:57:38.895968 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 466/904] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:38 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:57:39.912885 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a9b5f6d8-2b84-4371-8e99-ab9840b925e1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:39.913571 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a9b5f6d8-2b84-4371-8e99-ab9840b925e1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:39.920528 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9b5f6d8-2b84-4371-8e99-ab9840b925e1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:39.920982 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9b5f6d8-2b84-4371-8e99-ab9840b925e1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:39.921747 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9b5f6d8-2b84-4371-8e99-ab9840b925e1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:39.922173 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a9b5f6d8-2b84-4371-8e99-ab9840b925e1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:40.056193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a9b5f6d8-2b84-4371-8e99-ab9840b925e1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:40.063893 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a9b5f6d8-2b84-4371-8e99-ab9840b925e1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1682 microversion: 2.1 time: 0.155308 May 10 16:57:40.064504 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 439/905] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:39 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:41.058610 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-f37b9f03-4463-493d-833a-5f51959e4789 req-42d0a14f-8655-4cb7-8076-ef5ed9955c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c190231-eceb-49d6-a1e0-c8fff5d68042", "name": "network-vif-deleted", "tag": "d6c551a1-cfcf-4264-9a81-f760d5f6e8ab"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:41.087343 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-242ed84a-e21e-4291-9395-46696a7f0a23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:41.088072 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-242ed84a-e21e-4291-9395-46696a7f0a23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:41.095089 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-242ed84a-e21e-4291-9395-46696a7f0a23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:41.095539 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-242ed84a-e21e-4291-9395-46696a7f0a23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:41.101770 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-f37b9f03-4463-493d-833a-5f51959e4789 req-42d0a14f-8655-4cb7-8076-ef5ed9955c29 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:41.102216 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-f37b9f03-4463-493d-833a-5f51959e4789 req-42d0a14f-8655-4cb7-8076-ef5ed9955c29 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:41.108420 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-242ed84a-e21e-4291-9395-46696a7f0a23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:41.109333 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-242ed84a-e21e-4291-9395-46696a7f0a23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:41.125578 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-f37b9f03-4463-493d-833a-5f51959e4789 req-42d0a14f-8655-4cb7-8076-ef5ed9955c29 service nova] Creating event network-vif-deleted:d6c551a1-cfcf-4264-9a81-f760d5f6e8ab for instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 on hv-cinder-83588 May 10 16:57:41.131826 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-f37b9f03-4463-493d-833a-5f51959e4789 req-42d0a14f-8655-4cb7-8076-ef5ed9955c29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076785 May 10 16:57:41.133028 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 467/906] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:41.188130 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-242ed84a-e21e-4291-9395-46696a7f0a23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:41.197021 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-242ed84a-e21e-4291-9395-46696a7f0a23 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 200 len: 1326 microversion: 2.1 time: 0.119269 May 10 16:57:41.207545 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 440/907] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:41 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 1326 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:42.216106 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-28db896b-3e02-4d24-b61b-478c046d5bec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:42.217302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-28db896b-3e02-4d24-b61b-478c046d5bec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:42.223474 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-28db896b-3e02-4d24-b61b-478c046d5bec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:42.223926 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-28db896b-3e02-4d24-b61b-478c046d5bec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:42.224727 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-28db896b-3e02-4d24-b61b-478c046d5bec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:42.225164 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-28db896b-3e02-4d24-b61b-478c046d5bec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:42.238784 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-28db896b-3e02-4d24-b61b-478c046d5bec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-28db896b-3e02-4d24-b61b-478c046d5bec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 HTTP/1.1 May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:57:42.240411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:57:42.242088 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '4c190231-eceb-49d6-a1e0-c8fff5d68042'} May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:57:42.243098 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:57:42.244943 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:57:42.246559 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-28db896b-3e02-4d24-b61b-478c046d5bec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:57:42.246559 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-28db896b-3e02-4d24-b61b-478c046d5bec tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 404 len: 111 microversion: 2.1 time: 0.030591 May 10 16:57:42.246559 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 468/908] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:42 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:57:42.251052 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-91f2fd79-be09-4d49-9724-147bccc25b04 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '.version_select at 0x7f5fb6a06040>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:42.267496 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-91f2fd79-be09-4d49-9724-147bccc25b04 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167457296" status: 202 len: 0 microversion: 2.1 time: 0.020716 May 10 16:57:42.268053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 441/909] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 10 16:57:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167457296 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:57:42.879567 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-33be6dc3-450a-4528-bf7a-de44b57ede14 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: .version_select at 0x7f5fbfef7ee0>, body: {"keypair": {"name": "tempest-keypair-1122536131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJANG4MsxIzCJ4Orc3627PB3uCjRUd/083Mcm6FBiTUfMNlmQK5TbmC3rlO+fVYTGEmgRT8vzAjWnb0Cyp8oU/ckTHXzjIatCTihzoYYfygNfvsFrhxMIDY06dB6XWbVVQ=="}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:42.898470 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-33be6dc3-450a-4528-bf7a-de44b57ede14 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:57:42.903486 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-33be6dc3-450a-4528-bf7a-de44b57ede14 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for user 69585611ca7547adb43378445b4f1521 and project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'key_pairs'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:57:42.933752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-33be6dc3-450a-4528-bf7a-de44b57ede14 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058783 May 10 16:57:42.934349 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 469/910] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 10 16:57:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:44.184393 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-764104889", "imageRef": "d0479c3e-6b05-443f-a60d-9f7acf38b056", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46307fca-4b0a-4fde-a0d0-41f51f1065e5"}], "security_groups": [{"name": "tempest-securitygroup--1665253053"}], "key_name": "tempest-keypair-1122536131", "user_data": "}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:44.283162 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] validate_networks() for [('46307fca-4b0a-4fde-a0d0-41f51f1065e5', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:57:44.666471 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:57:44.666833 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:57:44.667316 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:57:44.667730 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:57:44.668142 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:57:44.678674 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:44.679124 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:44.679982 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:44.680603 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:44.699976 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:57:44.707694 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Getting quotas for user 69585611ca7547adb43378445b4f1521 and project a46a3e1f43434294a8e3d1ef8c04061b. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:57:44.720529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:57:44.722831 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0479c3e-6b05-443f-a60d-9f7acf38b056',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:57:44.773496 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-22eee400-dc2b-4dbc-a81d-e92019f9dadb tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.593741 May 10 16:57:44.774146 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 442/911] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:57:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:57:44.784622 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-58296a29-9df8-4a71-80f6-99c2efd805dd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:44.785298 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-58296a29-9df8-4a71-80f6-99c2efd805dd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:44.849539 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-58296a29-9df8-4a71-80f6-99c2efd805dd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:44.856977 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-58296a29-9df8-4a71-80f6-99c2efd805dd tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1241 microversion: 2.1 time: 0.076676 May 10 16:57:44.858412 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 470/912] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:44 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:45.875503 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-607bcf45-58d3-4607-bf96-9461b5e359fc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:45.876112 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-607bcf45-58d3-4607-bf96-9461b5e359fc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:45.882752 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-607bcf45-58d3-4607-bf96-9461b5e359fc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:45.883203 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-607bcf45-58d3-4607-bf96-9461b5e359fc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:45.883996 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-607bcf45-58d3-4607-bf96-9461b5e359fc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:45.884465 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-607bcf45-58d3-4607-bf96-9461b5e359fc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:45.950103 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-607bcf45-58d3-4607-bf96-9461b5e359fc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:45.958865 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-607bcf45-58d3-4607-bf96-9461b5e359fc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1299 microversion: 2.1 time: 0.088290 May 10 16:57:45.959451 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 443/913] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:45 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:46.979606 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-531eec6d-f492-4e58-9e43-702254fd62d6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:46.980975 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-531eec6d-f492-4e58-9e43-702254fd62d6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:46.989436 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-531eec6d-f492-4e58-9e43-702254fd62d6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:46.989908 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-531eec6d-f492-4e58-9e43-702254fd62d6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:46.990810 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-531eec6d-f492-4e58-9e43-702254fd62d6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:46.991326 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-531eec6d-f492-4e58-9e43-702254fd62d6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:47.186842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-bf4f2040-0f1d-4dff-91f6-0590e6ab2ab4 req-df429d7a-0a7c-4330-81c8-e407f426ffab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5391c0c-c286-47e5-9ad9-68018ba1a4f2", "tag": "8d105744-57a6-46a3-8258-83bacd585f58"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:47.208257 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-bf4f2040-0f1d-4dff-91f6-0590e6ab2ab4 req-df429d7a-0a7c-4330-81c8-e407f426ffab service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:47.212878 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-bf4f2040-0f1d-4dff-91f6-0590e6ab2ab4 req-df429d7a-0a7c-4330-81c8-e407f426ffab service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:47.221465 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-531eec6d-f492-4e58-9e43-702254fd62d6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:47.231361 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-531eec6d-f492-4e58-9e43-702254fd62d6 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1367 microversion: 2.1 time: 0.258074 May 10 16:57:47.233023 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 471/914] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:46 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:47.242518 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-bf4f2040-0f1d-4dff-91f6-0590e6ab2ab4 req-df429d7a-0a7c-4330-81c8-e407f426ffab service nova] Creating event network-changed:8d105744-57a6-46a3-8258-83bacd585f58 for instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 on hv-cinder-83588 May 10 16:57:47.247939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-bf4f2040-0f1d-4dff-91f6-0590e6ab2ab4 req-df429d7a-0a7c-4330-81c8-e407f426ffab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065583 May 10 16:57:47.249121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 444/915] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:48.247978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6471f923-07ac-47c0-a5d5-35dad8934d08 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:48.248729 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6471f923-07ac-47c0-a5d5-35dad8934d08 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:48.255066 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6471f923-07ac-47c0-a5d5-35dad8934d08 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:48.255511 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6471f923-07ac-47c0-a5d5-35dad8934d08 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:48.256288 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6471f923-07ac-47c0-a5d5-35dad8934d08 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:48.256735 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-6471f923-07ac-47c0-a5d5-35dad8934d08 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:48.479603 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6471f923-07ac-47c0-a5d5-35dad8934d08 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:48.487849 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6471f923-07ac-47c0-a5d5-35dad8934d08 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1367 microversion: 2.1 time: 0.243703 May 10 16:57:48.488450 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 472/916] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:48 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:49.506518 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cac341d2-fc05-4e34-a654-47ee2b1c2b95 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:49.507216 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cac341d2-fc05-4e34-a654-47ee2b1c2b95 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:49.513228 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cac341d2-fc05-4e34-a654-47ee2b1c2b95 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:49.513685 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cac341d2-fc05-4e34-a654-47ee2b1c2b95 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:49.514464 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cac341d2-fc05-4e34-a654-47ee2b1c2b95 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:49.514901 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cac341d2-fc05-4e34-a654-47ee2b1c2b95 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:49.650202 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cac341d2-fc05-4e34-a654-47ee2b1c2b95 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:49.658226 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cac341d2-fc05-4e34-a654-47ee2b1c2b95 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1367 microversion: 2.1 time: 0.156434 May 10 16:57:49.658954 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 445/917] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:49 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:50.130865 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-d053a3a9-a810-4641-8da4-d212fb2d7111 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:50.131476 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d053a3a9-a810-4641-8da4-d212fb2d7111 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:50.137673 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d053a3a9-a810-4641-8da4-d212fb2d7111 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:50.138119 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d053a3a9-a810-4641-8da4-d212fb2d7111 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:50.139369 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d053a3a9-a810-4641-8da4-d212fb2d7111 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:50.139888 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-d053a3a9-a810-4641-8da4-d212fb2d7111 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:50.165578 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-d053a3a9-a810-4641-8da4-d212fb2d7111 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Going to try to terminate instance {{(pid=134195) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:57:50.237345 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-d053a3a9-a810-4641-8da4-d212fb2d7111 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "DELETE /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 204 len: 0 microversion: 2.1 time: 0.109998 May 10 16:57:50.241015 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 473/918] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:57:50 2022] DELETE /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:57:50.246200 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d9dc1912-0b68-414b-8c44-b0785da0f1a0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:50.246893 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d9dc1912-0b68-414b-8c44-b0785da0f1a0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:50.253277 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d9dc1912-0b68-414b-8c44-b0785da0f1a0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:50.253915 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d9dc1912-0b68-414b-8c44-b0785da0f1a0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:50.254665 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d9dc1912-0b68-414b-8c44-b0785da0f1a0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:50.255103 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d9dc1912-0b68-414b-8c44-b0785da0f1a0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:50.385427 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d9dc1912-0b68-414b-8c44-b0785da0f1a0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:50.393484 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d9dc1912-0b68-414b-8c44-b0785da0f1a0 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1575 microversion: 2.1 time: 0.151099 May 10 16:57:50.394261 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 446/919] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:50 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:57:50.675969 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f244c2cf-bab1-4764-8587-fa08e5982268 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:50.676709 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f244c2cf-bab1-4764-8587-fa08e5982268 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:50.682729 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f244c2cf-bab1-4764-8587-fa08e5982268 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:50.683179 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f244c2cf-bab1-4764-8587-fa08e5982268 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:50.683938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f244c2cf-bab1-4764-8587-fa08e5982268 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:50.684398 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f244c2cf-bab1-4764-8587-fa08e5982268 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:50.817080 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-f244c2cf-bab1-4764-8587-fa08e5982268 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:50.824962 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f244c2cf-bab1-4764-8587-fa08e5982268 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1367 microversion: 2.1 time: 0.153238 May 10 16:57:50.825537 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 474/920] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:50 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:51.411383 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5ddfa621-f684-48c4-ab3f-ec0431d3eaaa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:51.411992 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5ddfa621-f684-48c4-ab3f-ec0431d3eaaa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:51.418174 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5ddfa621-f684-48c4-ab3f-ec0431d3eaaa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:51.418625 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5ddfa621-f684-48c4-ab3f-ec0431d3eaaa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:51.419393 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5ddfa621-f684-48c4-ab3f-ec0431d3eaaa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:51.420438 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5ddfa621-f684-48c4-ab3f-ec0431d3eaaa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:51.552854 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-5ddfa621-f684-48c4-ab3f-ec0431d3eaaa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:51.561471 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-5ddfa621-f684-48c4-ab3f-ec0431d3eaaa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1575 microversion: 2.1 time: 0.153943 May 10 16:57:51.562057 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 447/921] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:51 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:51.668868 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-9fd3a8d0-531d-42c5-aef5-90dbd02e5039 req-d2d3ea8f-c739-413f-a853-301aab658a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5391c0c-c286-47e5-9ad9-68018ba1a4f2", "name": "network-vif-plugged", "status": "completed", "tag": "8d105744-57a6-46a3-8258-83bacd585f58"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:51.678593 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-9fd3a8d0-531d-42c5-aef5-90dbd02e5039 req-d2d3ea8f-c739-413f-a853-301aab658a41 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:51.679053 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-9fd3a8d0-531d-42c5-aef5-90dbd02e5039 req-d2d3ea8f-c739-413f-a853-301aab658a41 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:51.691897 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-9fd3a8d0-531d-42c5-aef5-90dbd02e5039 req-d2d3ea8f-c739-413f-a853-301aab658a41 service nova] Creating event network-vif-plugged:8d105744-57a6-46a3-8258-83bacd585f58 for instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 on hv-cinder-83588 May 10 16:57:51.697185 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-9fd3a8d0-531d-42c5-aef5-90dbd02e5039 req-d2d3ea8f-c739-413f-a853-301aab658a41 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032061 May 10 16:57:51.698131 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 475/922] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:51.842112 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-22d028e4-e830-4019-bddd-ee21124db420 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:51.843051 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-22d028e4-e830-4019-bddd-ee21124db420 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:51.849721 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22d028e4-e830-4019-bddd-ee21124db420 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:51.850175 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22d028e4-e830-4019-bddd-ee21124db420 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:51.851148 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22d028e4-e830-4019-bddd-ee21124db420 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:51.851756 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-22d028e4-e830-4019-bddd-ee21124db420 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:51.987838 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-22d028e4-e830-4019-bddd-ee21124db420 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:51.995418 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-22d028e4-e830-4019-bddd-ee21124db420 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1367 microversion: 2.1 time: 0.157354 May 10 16:57:52.000332 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 448/923] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:51 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:52.579831 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-56122654-98d0-4abd-a29f-a934402e7562 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:52.580632 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-56122654-98d0-4abd-a29f-a934402e7562 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:52.592954 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-56122654-98d0-4abd-a29f-a934402e7562 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:52.593411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-56122654-98d0-4abd-a29f-a934402e7562 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:52.594217 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-56122654-98d0-4abd-a29f-a934402e7562 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:52.594663 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-56122654-98d0-4abd-a29f-a934402e7562 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:52.901005 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-56122654-98d0-4abd-a29f-a934402e7562 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:52.909278 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-56122654-98d0-4abd-a29f-a934402e7562 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 200 len: 1507 microversion: 2.1 time: 0.334041 May 10 16:57:52.909861 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 476/924] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:52 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:53.014838 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a6623d10-54d5-4ff2-a3e5-bd00d60fdacc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:53.015466 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a6623d10-54d5-4ff2-a3e5-bd00d60fdacc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:53.022525 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a6623d10-54d5-4ff2-a3e5-bd00d60fdacc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:53.023002 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a6623d10-54d5-4ff2-a3e5-bd00d60fdacc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:53.024052 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a6623d10-54d5-4ff2-a3e5-bd00d60fdacc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:53.024538 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a6623d10-54d5-4ff2-a3e5-bd00d60fdacc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:53.030786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-ce742a1d-bdf1-420b-97a1-67dfd11386bb req-f054cdf4-d132-47a2-94c9-9b8f9d66958e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d3be1d-f8ff-4768-950e-8cc38569d771", "name": "network-vif-deleted", "tag": "7509683f-2476-48cf-bc4c-a50c8e6f5603"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:53.039077 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-ce742a1d-bdf1-420b-97a1-67dfd11386bb req-f054cdf4-d132-47a2-94c9-9b8f9d66958e service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:53.039615 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-ce742a1d-bdf1-420b-97a1-67dfd11386bb req-f054cdf4-d132-47a2-94c9-9b8f9d66958e service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:53.051831 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-ce742a1d-bdf1-420b-97a1-67dfd11386bb req-f054cdf4-d132-47a2-94c9-9b8f9d66958e service nova] Creating event network-vif-deleted:7509683f-2476-48cf-bc4c-a50c8e6f5603 for instance 00d3be1d-f8ff-4768-950e-8cc38569d771 on hv-cinder-83588 May 10 16:57:53.056586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-ce742a1d-bdf1-420b-97a1-67dfd11386bb req-f054cdf4-d132-47a2-94c9-9b8f9d66958e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030092 May 10 16:57:53.057281 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 477/925] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:53.174698 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a6623d10-54d5-4ff2-a3e5-bd00d60fdacc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:53.187017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a6623d10-54d5-4ff2-a3e5-bd00d60fdacc tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1367 microversion: 2.1 time: 0.176958 May 10 16:57:53.188011 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 449/926] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:53 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:53.929956 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ce00771a-47d0-49ae-a858-9fb3d5fd7344 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:53.930894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ce00771a-47d0-49ae-a858-9fb3d5fd7344 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:53.941539 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce00771a-47d0-49ae-a858-9fb3d5fd7344 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:53.942369 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce00771a-47d0-49ae-a858-9fb3d5fd7344 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:53.943893 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce00771a-47d0-49ae-a858-9fb3d5fd7344 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:53.944214 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ce00771a-47d0-49ae-a858-9fb3d5fd7344 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:53.961525 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-ce00771a-47d0-49ae-a858-9fb3d5fd7344 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] HTTP exception thrown: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ce00771a-47d0-49ae-a858-9fb3d5fd7344 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Request method failure captured: May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 HTTP/1.1 May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepjwXWkcZx8fdNuIhlagIKAe2rPPbeB7-tsPIBcLhVhRwOgv69uzq7zmpdwHxuDIbAht7CyNKaYaHfWnwzFWL6i1UfuV8qzsE6QL43t4eRPSyDJy3YGZLNaHVrjOIHrLz2QEhg-av_GYPnIhuFDlZ5RSu-GePeakWw6Zc4-lDTTuXGw May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 0b8348f4bffd44e7b0da6367a1011709 May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-TestVolumeBootPattern-554040557 May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:57:53.963786 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-TestVolumeBootPattern-554040557 May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 0b8348f4bffd44e7b0da6367a1011709 May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-TestVolumeBootPattern-554040557 May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-TestVolumeBootPattern-554040557-project May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: fe1f5f6882eb4a9aa869ad32fbdb0d92 May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-TestVolumeBootPattern-554040557-project May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 16:57:53.965432 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '00d3be1d-f8ff-4768-950e-8cc38569d771'} May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:57:53.966594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 16:57:53.968751 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:57:53.969919 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ce00771a-47d0-49ae-a858-9fb3d5fd7344 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Returning 404 to user: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:57:53.969919 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ce00771a-47d0-49ae-a858-9fb3d5fd7344 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 404 len: 111 microversion: 2.1 time: 0.041441 May 10 16:57:53.969919 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 478/927] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:53 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:57:54.070474 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1498098366", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-578502746", "security_groups": [{"name": "tempest-secgroup-smoke-1747529592"}], "block_device_mapping_v2": [{"uuid": "9f7bc6e6-e41d-4062-b5b7-8dee93ac7237", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4630e6fb-ee22-4d27-bd44-871c41a7cdec"}]}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:54.198434 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] validate_networks() for [('4630e6fb-ee22-4d27-bd44-871c41a7cdec', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:57:54.203399 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-658ae190-2015-4f3e-9a4b-8d2604c8d1a7 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:54.204046 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-658ae190-2015-4f3e-9a4b-8d2604c8d1a7 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:54.210240 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-658ae190-2015-4f3e-9a4b-8d2604c8d1a7 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:54.210693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-658ae190-2015-4f3e-9a4b-8d2604c8d1a7 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:54.211478 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-658ae190-2015-4f3e-9a4b-8d2604c8d1a7 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:54.211920 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-658ae190-2015-4f3e-9a4b-8d2604c8d1a7 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:54.355667 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-658ae190-2015-4f3e-9a4b-8d2604c8d1a7 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:54.364477 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-658ae190-2015-4f3e-9a4b-8d2604c8d1a7 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1558 microversion: 2.1 time: 0.164810 May 10 16:57:54.369307 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 479/928] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:54 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:57:54.382033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c6f44494-bc8e-497b-b737-9dac6f282aaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:54.382557 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c6f44494-bc8e-497b-b737-9dac6f282aaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:54.388858 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c6f44494-bc8e-497b-b737-9dac6f282aaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:54.390013 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c6f44494-bc8e-497b-b737-9dac6f282aaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:54.390811 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c6f44494-bc8e-497b-b737-9dac6f282aaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:54.391257 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c6f44494-bc8e-497b-b737-9dac6f282aaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:54.474622 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c6f44494-bc8e-497b-b737-9dac6f282aaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096795 May 10 16:57:54.475219 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 480/929] 10.222.0.48 () {58 vars in 1274 bytes} [Tue May 10 16:57:54 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:57:54.595966 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:57:54.596591 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:57:54.597074 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:57:54.597482 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:57:54.597890 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:57:54.607038 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:54.608085 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:54.608993 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:54.609430 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:54.626899 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Getting quotas for project 0b8348f4bffd44e7b0da6367a1011709. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:57:54.630948 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Getting quotas for user fe1f5f6882eb4a9aa869ad32fbdb0d92 and project 0b8348f4bffd44e7b0da6367a1011709. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:57:54.695445 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:57:54.698201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f7bc6e6-e41d-4062-b5b7-8dee93ac7237',volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:57:54.854084 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b21c6f4e-286e-4d60-bf90-d3060856df44 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787390 May 10 16:57:54.855631 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 450/930] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:57:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:57:54.866967 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-6805b736-1a94-4271-ae0c-cc9f99b43663 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:54.867663 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-6805b736-1a94-4271-ae0c-cc9f99b43663 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:54.954452 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-6805b736-1a94-4271-ae0c-cc9f99b43663 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:54.969382 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-6805b736-1a94-4271-ae0c-cc9f99b43663 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1094 microversion: 2.1 time: 0.106322 May 10 16:57:54.970303 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 481/931] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:54 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:55.623044 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-7e5f3665-d59d-4768-9ac9-c56458e9779e req-d1500ecc-ef38-4722-b489-c3c01cf8d06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5391c0c-c286-47e5-9ad9-68018ba1a4f2", "tag": "8d105744-57a6-46a3-8258-83bacd585f58"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:55.641671 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-7e5f3665-d59d-4768-9ac9-c56458e9779e req-d1500ecc-ef38-4722-b489-c3c01cf8d06a service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:55.642120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-7e5f3665-d59d-4768-9ac9-c56458e9779e req-d1500ecc-ef38-4722-b489-c3c01cf8d06a service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:55.653298 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-7e5f3665-d59d-4768-9ac9-c56458e9779e req-d1500ecc-ef38-4722-b489-c3c01cf8d06a service nova] Creating event network-changed:8d105744-57a6-46a3-8258-83bacd585f58 for instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 on hv-cinder-83588 May 10 16:57:55.658869 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-7e5f3665-d59d-4768-9ac9-c56458e9779e req-d1500ecc-ef38-4722-b489-c3c01cf8d06a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040883 May 10 16:57:55.659664 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 451/932] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:55.987696 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ecb5925f-7f11-4666-85da-f04dde004ef1 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:55.988367 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ecb5925f-7f11-4666-85da-f04dde004ef1 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:55.995594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ecb5925f-7f11-4666-85da-f04dde004ef1 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:55.996320 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ecb5925f-7f11-4666-85da-f04dde004ef1 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:55.997299 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ecb5925f-7f11-4666-85da-f04dde004ef1 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:55.997960 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ecb5925f-7f11-4666-85da-f04dde004ef1 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:56.087379 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ecb5925f-7f11-4666-85da-f04dde004ef1 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:56.096187 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ecb5925f-7f11-4666-85da-f04dde004ef1 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1210 microversion: 2.1 time: 0.112112 May 10 16:57:56.097199 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 482/933] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:55 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:57.115590 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-29264d43-28c6-42bc-8582-3a11a2e85eae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:57.116313 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-29264d43-28c6-42bc-8582-3a11a2e85eae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:57.122466 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-29264d43-28c6-42bc-8582-3a11a2e85eae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:57.122917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-29264d43-28c6-42bc-8582-3a11a2e85eae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:57.124473 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-29264d43-28c6-42bc-8582-3a11a2e85eae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:57.125026 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-29264d43-28c6-42bc-8582-3a11a2e85eae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:57.300941 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-29264d43-28c6-42bc-8582-3a11a2e85eae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:57.308459 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-29264d43-28c6-42bc-8582-3a11a2e85eae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1266 microversion: 2.1 time: 0.197729 May 10 16:57:57.309035 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 452/934] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:57 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:57.676394 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-f72a2c5e-cc05-4f50-9ad3-38145cb3b21c req-00d71afc-38b2-41f1-a728-f36c35e14e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4369776b-ef35-4d80-8a7d-0d79609863c7", "tag": "08ff1226-2ba9-4c73-a826-9f811db89a93"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:57:57.690950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-f72a2c5e-cc05-4f50-9ad3-38145cb3b21c req-00d71afc-38b2-41f1-a728-f36c35e14e0b service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:57.691481 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-f72a2c5e-cc05-4f50-9ad3-38145cb3b21c req-00d71afc-38b2-41f1-a728-f36c35e14e0b service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:57.705953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-f72a2c5e-cc05-4f50-9ad3-38145cb3b21c req-00d71afc-38b2-41f1-a728-f36c35e14e0b service nova] Creating event network-changed:08ff1226-2ba9-4c73-a826-9f811db89a93 for instance 4369776b-ef35-4d80-8a7d-0d79609863c7 on hv-cinder-83588 May 10 16:57:57.713354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-f72a2c5e-cc05-4f50-9ad3-38145cb3b21c req-00d71afc-38b2-41f1-a728-f36c35e14e0b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041157 May 10 16:57:57.714354 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 483/935] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:57:58.325860 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-aa736651-98e3-4589-bf03-7daa143d328f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:58.327281 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-aa736651-98e3-4589-bf03-7daa143d328f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:58.334039 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aa736651-98e3-4589-bf03-7daa143d328f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:58.334431 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aa736651-98e3-4589-bf03-7daa143d328f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:58.335305 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aa736651-98e3-4589-bf03-7daa143d328f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:58.335809 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-aa736651-98e3-4589-bf03-7daa143d328f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:58.477350 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-aa736651-98e3-4589-bf03-7daa143d328f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:58.485532 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-aa736651-98e3-4589-bf03-7daa143d328f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1266 microversion: 2.1 time: 0.163518 May 10 16:57:58.486149 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 453/936] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:58 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:57:59.503385 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-bc407451-18e8-4b2e-9956-c3a87f1d5b01 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:57:59.504089 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-bc407451-18e8-4b2e-9956-c3a87f1d5b01 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:57:59.510263 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bc407451-18e8-4b2e-9956-c3a87f1d5b01 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:59.510712 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bc407451-18e8-4b2e-9956-c3a87f1d5b01 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:59.511485 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bc407451-18e8-4b2e-9956-c3a87f1d5b01 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:57:59.511922 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bc407451-18e8-4b2e-9956-c3a87f1d5b01 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:57:59.647439 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bc407451-18e8-4b2e-9956-c3a87f1d5b01 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:57:59.655667 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-bc407451-18e8-4b2e-9956-c3a87f1d5b01 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1266 microversion: 2.1 time: 0.156738 May 10 16:57:59.656251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 484/937] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:57:59 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:00.673092 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-6cecc5cf-ff88-45e3-a844-0b771b132f79 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:00.673989 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-6cecc5cf-ff88-45e3-a844-0b771b132f79 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:00.680524 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6cecc5cf-ff88-45e3-a844-0b771b132f79 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:00.680985 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6cecc5cf-ff88-45e3-a844-0b771b132f79 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:00.681770 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6cecc5cf-ff88-45e3-a844-0b771b132f79 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:00.682213 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-6cecc5cf-ff88-45e3-a844-0b771b132f79 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:00.813988 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-6cecc5cf-ff88-45e3-a844-0b771b132f79 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:00.821369 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-6cecc5cf-ff88-45e3-a844-0b771b132f79 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1266 microversion: 2.1 time: 0.152915 May 10 16:58:00.821939 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 454/938] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:00 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:01.839057 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-579e969b-9c2a-4830-80be-81b6c172c089 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:01.839605 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-579e969b-9c2a-4830-80be-81b6c172c089 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:01.846801 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-579e969b-9c2a-4830-80be-81b6c172c089 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:01.847261 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-579e969b-9c2a-4830-80be-81b6c172c089 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:01.848036 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-579e969b-9c2a-4830-80be-81b6c172c089 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:01.848528 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-579e969b-9c2a-4830-80be-81b6c172c089 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:01.981160 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-579e969b-9c2a-4830-80be-81b6c172c089 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:01.988574 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-579e969b-9c2a-4830-80be-81b6c172c089 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1266 microversion: 2.1 time: 0.153439 May 10 16:58:01.989134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 485/939] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:01 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:03.005232 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b58493a3-a64e-4d6c-90eb-0938aca95136 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:03.005879 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b58493a3-a64e-4d6c-90eb-0938aca95136 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:03.012261 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b58493a3-a64e-4d6c-90eb-0938aca95136 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:03.012748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b58493a3-a64e-4d6c-90eb-0938aca95136 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:03.013530 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b58493a3-a64e-4d6c-90eb-0938aca95136 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:03.014092 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b58493a3-a64e-4d6c-90eb-0938aca95136 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:03.306408 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b58493a3-a64e-4d6c-90eb-0938aca95136 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:03.314826 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b58493a3-a64e-4d6c-90eb-0938aca95136 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1266 microversion: 2.1 time: 0.313428 May 10 16:58:03.315402 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 455/940] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:03 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:04.331968 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c46e50b7-0b1f-4b8d-82b0-e3b10839845f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:04.332722 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c46e50b7-0b1f-4b8d-82b0-e3b10839845f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:04.339193 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c46e50b7-0b1f-4b8d-82b0-e3b10839845f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:04.339646 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c46e50b7-0b1f-4b8d-82b0-e3b10839845f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:04.340458 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c46e50b7-0b1f-4b8d-82b0-e3b10839845f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:04.340897 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c46e50b7-0b1f-4b8d-82b0-e3b10839845f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:04.749897 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-c46e50b7-0b1f-4b8d-82b0-e3b10839845f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:04.757449 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c46e50b7-0b1f-4b8d-82b0-e3b10839845f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1266 microversion: 2.1 time: 0.429679 May 10 16:58:04.758048 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 486/941] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:04 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1266 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:05.776730 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f7a0d398-af27-4332-8f37-2fd1632b5d86 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:05.777251 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f7a0d398-af27-4332-8f37-2fd1632b5d86 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:05.784724 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f7a0d398-af27-4332-8f37-2fd1632b5d86 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:05.785174 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f7a0d398-af27-4332-8f37-2fd1632b5d86 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:05.785941 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f7a0d398-af27-4332-8f37-2fd1632b5d86 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:05.786376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f7a0d398-af27-4332-8f37-2fd1632b5d86 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:05.930640 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f7a0d398-af27-4332-8f37-2fd1632b5d86 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:05.938315 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f7a0d398-af27-4332-8f37-2fd1632b5d86 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1266 microversion: 2.1 time: 0.166597 May 10 16:58:05.938902 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 456/942] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:05 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:06.955672 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9746ee08-e229-4cb7-9b2b-d3484fc30eb8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:06.956315 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9746ee08-e229-4cb7-9b2b-d3484fc30eb8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:06.962918 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9746ee08-e229-4cb7-9b2b-d3484fc30eb8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:06.963374 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9746ee08-e229-4cb7-9b2b-d3484fc30eb8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:06.964166 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9746ee08-e229-4cb7-9b2b-d3484fc30eb8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:06.964641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9746ee08-e229-4cb7-9b2b-d3484fc30eb8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:07.162076 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9746ee08-e229-4cb7-9b2b-d3484fc30eb8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:07.169686 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9746ee08-e229-4cb7-9b2b-d3484fc30eb8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1266 microversion: 2.1 time: 0.218510 May 10 16:58:07.170272 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 487/943] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:06 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:07.716625 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-b806bade-3661-4034-8198-1c8a936025b7 req-424a20e7-38e5-40f4-9c75-97cf6d9366e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4369776b-ef35-4d80-8a7d-0d79609863c7", "name": "network-vif-plugged", "status": "completed", "tag": "08ff1226-2ba9-4c73-a826-9f811db89a93"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:58:07.725494 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-b806bade-3661-4034-8198-1c8a936025b7 req-424a20e7-38e5-40f4-9c75-97cf6d9366e9 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:07.725935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-b806bade-3661-4034-8198-1c8a936025b7 req-424a20e7-38e5-40f4-9c75-97cf6d9366e9 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:07.742991 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-b806bade-3661-4034-8198-1c8a936025b7 req-424a20e7-38e5-40f4-9c75-97cf6d9366e9 service nova] Creating event network-vif-plugged:08ff1226-2ba9-4c73-a826-9f811db89a93 for instance 4369776b-ef35-4d80-8a7d-0d79609863c7 on hv-cinder-83588 May 10 16:58:07.748183 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-b806bade-3661-4034-8198-1c8a936025b7 req-424a20e7-38e5-40f4-9c75-97cf6d9366e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035656 May 10 16:58:07.749891 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 457/944] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:58:08.187046 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-51517616-a707-4b33-b942-0e65c7583195 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:08.187685 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-51517616-a707-4b33-b942-0e65c7583195 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:08.194173 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51517616-a707-4b33-b942-0e65c7583195 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:08.194627 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51517616-a707-4b33-b942-0e65c7583195 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:08.195402 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51517616-a707-4b33-b942-0e65c7583195 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:08.195843 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-51517616-a707-4b33-b942-0e65c7583195 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:08.331787 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-51517616-a707-4b33-b942-0e65c7583195 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:08.342181 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-51517616-a707-4b33-b942-0e65c7583195 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1266 microversion: 2.1 time: 0.159147 May 10 16:58:08.343828 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 488/945] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:08 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:09.362056 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-83be79f3-5713-4f55-add5-a2f5cb99a6f3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:09.362794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-83be79f3-5713-4f55-add5-a2f5cb99a6f3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:09.369292 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-83be79f3-5713-4f55-add5-a2f5cb99a6f3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:09.369743 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-83be79f3-5713-4f55-add5-a2f5cb99a6f3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:09.370523 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-83be79f3-5713-4f55-add5-a2f5cb99a6f3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:09.370960 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-83be79f3-5713-4f55-add5-a2f5cb99a6f3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:09.525560 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-83be79f3-5713-4f55-add5-a2f5cb99a6f3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:09.534091 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-83be79f3-5713-4f55-add5-a2f5cb99a6f3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1452 microversion: 2.1 time: 0.177690 May 10 16:58:09.534680 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 458/946] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:09 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:09.550708 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ab0a40f0-c083-4b16-915c-badbe100e2a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:09.551411 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ab0a40f0-c083-4b16-915c-badbe100e2a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:09.558046 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ab0a40f0-c083-4b16-915c-badbe100e2a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:09.558501 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ab0a40f0-c083-4b16-915c-badbe100e2a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:09.559283 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ab0a40f0-c083-4b16-915c-badbe100e2a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:09.559725 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ab0a40f0-c083-4b16-915c-badbe100e2a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:09.700748 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ab0a40f0-c083-4b16-915c-badbe100e2a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:09.708547 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ab0a40f0-c083-4b16-915c-badbe100e2a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1452 microversion: 2.1 time: 0.161829 May 10 16:58:09.709134 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 489/947] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:09 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:11.422168 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-09f8a0f2-106d-44d2-882a-74ef076f06f9 req-2d636d92-9ff5-4e43-97a3-c1e9f0faa9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4369776b-ef35-4d80-8a7d-0d79609863c7", "tag": "08ff1226-2ba9-4c73-a826-9f811db89a93"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:58:11.431213 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-09f8a0f2-106d-44d2-882a-74ef076f06f9 req-2d636d92-9ff5-4e43-97a3-c1e9f0faa9cc service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:11.431660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-09f8a0f2-106d-44d2-882a-74ef076f06f9 req-2d636d92-9ff5-4e43-97a3-c1e9f0faa9cc service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:11.443214 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-09f8a0f2-106d-44d2-882a-74ef076f06f9 req-2d636d92-9ff5-4e43-97a3-c1e9f0faa9cc service nova] Creating event network-changed:08ff1226-2ba9-4c73-a826-9f811db89a93 for instance 4369776b-ef35-4d80-8a7d-0d79609863c7 on hv-cinder-83588 May 10 16:58:11.448215 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-09f8a0f2-106d-44d2-882a-74ef076f06f9 req-2d636d92-9ff5-4e43-97a3-c1e9f0faa9cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030689 May 10 16:58:11.448849 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 459/948] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:58:27.504383 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-c6fd7ea6-bb7b-45e3-817c-a7fd14d02522 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:27.505025 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-c6fd7ea6-bb7b-45e3-817c-a7fd14d02522 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:27.511153 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c6fd7ea6-bb7b-45e3-817c-a7fd14d02522 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:27.511612 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c6fd7ea6-bb7b-45e3-817c-a7fd14d02522 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:27.512431 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c6fd7ea6-bb7b-45e3-817c-a7fd14d02522 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:27.512872 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-c6fd7ea6-bb7b-45e3-817c-a7fd14d02522 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:27.538529 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-c6fd7ea6-bb7b-45e3-817c-a7fd14d02522 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/ips" status: 200 len: 150 microversion: 2.1 time: 0.038775 May 10 16:58:27.539109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 490/949] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 10 16:58:27 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:58:28.880868 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-9ca34169-6f4a-4c65-9aa8-9bc45fd2b4f4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "780d413f-513a-4748-b34c-725d813f4ecf"}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:58:28.882036 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-9ca34169-6f4a-4c65-9aa8-9bc45fd2b4f4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:28.888094 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9ca34169-6f4a-4c65-9aa8-9bc45fd2b4f4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:28.888577 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9ca34169-6f4a-4c65-9aa8-9bc45fd2b4f4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:28.889342 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9ca34169-6f4a-4c65-9aa8-9bc45fd2b4f4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:28.889779 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-9ca34169-6f4a-4c65-9aa8-9bc45fd2b4f4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:29.130348 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-9ca34169-6f4a-4c65-9aa8-9bc45fd2b4f4 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "POST /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254705 May 10 16:58:29.131006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 460/950] 10.222.0.48 () {60 vars in 1322 bytes} [Tue May 10 16:58:28 2022] POST /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:58:35.663008 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-f4ca6adc-94cf-473f-91b9-770359149963 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:35.663537 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-f4ca6adc-94cf-473f-91b9-770359149963 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:35.669962 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f4ca6adc-94cf-473f-91b9-770359149963 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:35.670396 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f4ca6adc-94cf-473f-91b9-770359149963 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:35.671167 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f4ca6adc-94cf-473f-91b9-770359149963 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:35.671607 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-f4ca6adc-94cf-473f-91b9-770359149963 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:35.749498 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-f4ca6adc-94cf-473f-91b9-770359149963 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lazy-loading 'services' on Instance uuid f5391c0c-c286-47e5-9ad9-68018ba1a4f2 {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:58:35.819896 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-f4ca6adc-94cf-473f-91b9-770359149963 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/os-volume_attachments/780d413f-513a-4748-b34c-725d813f4ecf" status: 202 len: 0 microversion: 2.1 time: 0.160679 May 10 16:58:35.820545 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 491/951] 10.222.0.48 () {58 vars in 1415 bytes} [Tue May 10 16:58:35 2022] DELETE /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/os-volume_attachments/780d413f-513a-4748-b34c-725d813f4ecf => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 16:58:35.832249 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b6f73af6-5596-46b6-8103-f77cf053f005 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:35.833328 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b6f73af6-5596-46b6-8103-f77cf053f005 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:35.840576 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b6f73af6-5596-46b6-8103-f77cf053f005 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:35.841023 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b6f73af6-5596-46b6-8103-f77cf053f005 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:35.841811 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b6f73af6-5596-46b6-8103-f77cf053f005 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:35.842251 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b6f73af6-5596-46b6-8103-f77cf053f005 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:35.873979 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b6f73af6-5596-46b6-8103-f77cf053f005 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048762 May 10 16:58:35.874387 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 461/952] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:58:35 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:58:36.887626 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-10fc45a9-c3f8-4f04-8b6d-14a5c372f01c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:36.888772 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-10fc45a9-c3f8-4f04-8b6d-14a5c372f01c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:36.895932 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-10fc45a9-c3f8-4f04-8b6d-14a5c372f01c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:36.896419 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-10fc45a9-c3f8-4f04-8b6d-14a5c372f01c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:36.897198 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-10fc45a9-c3f8-4f04-8b6d-14a5c372f01c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:36.897639 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-10fc45a9-c3f8-4f04-8b6d-14a5c372f01c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:36.926667 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-10fc45a9-c3f8-4f04-8b6d-14a5c372f01c tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043900 May 10 16:58:36.927231 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 492/953] 10.222.0.48 () {58 vars in 1301 bytes} [Tue May 10 16:58:36 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:58:36.983197 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f9555bcc-c5ea-4b36-bc83-b9e405ab2d07 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:36.983712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f9555bcc-c5ea-4b36-bc83-b9e405ab2d07 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:36.990048 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f9555bcc-c5ea-4b36-bc83-b9e405ab2d07 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:36.990499 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f9555bcc-c5ea-4b36-bc83-b9e405ab2d07 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:36.991266 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f9555bcc-c5ea-4b36-bc83-b9e405ab2d07 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:36.991701 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f9555bcc-c5ea-4b36-bc83-b9e405ab2d07 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:37.016089 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f9555bcc-c5ea-4b36-bc83-b9e405ab2d07 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:58:37.092742 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f9555bcc-c5ea-4b36-bc83-b9e405ab2d07 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 204 len: 0 microversion: 2.1 time: 0.113083 May 10 16:58:37.093326 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 462/954] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:58:36 2022] DELETE /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:58:37.101642 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-bb50271a-7bdb-433f-8f71-e3cfae59e204 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:37.102271 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-bb50271a-7bdb-433f-8f71-e3cfae59e204 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:37.108370 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bb50271a-7bdb-433f-8f71-e3cfae59e204 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:37.108836 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bb50271a-7bdb-433f-8f71-e3cfae59e204 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:37.109609 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bb50271a-7bdb-433f-8f71-e3cfae59e204 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:37.110541 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bb50271a-7bdb-433f-8f71-e3cfae59e204 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:37.484877 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bb50271a-7bdb-433f-8f71-e3cfae59e204 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:37.493141 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-bb50271a-7bdb-433f-8f71-e3cfae59e204 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1682 microversion: 2.1 time: 0.395311 May 10 16:58:37.493731 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 493/955] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:37 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1682 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:58:38.511517 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-8f2ed65a-08a4-49f3-8db5-b40407c7bbaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:38.512220 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-8f2ed65a-08a4-49f3-8db5-b40407c7bbaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:38.519885 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f2ed65a-08a4-49f3-8db5-b40407c7bbaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:38.520364 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f2ed65a-08a4-49f3-8db5-b40407c7bbaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:38.521149 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f2ed65a-08a4-49f3-8db5-b40407c7bbaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:38.521590 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-8f2ed65a-08a4-49f3-8db5-b40407c7bbaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:38.652248 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-8f2ed65a-08a4-49f3-8db5-b40407c7bbaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:38.659893 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-8f2ed65a-08a4-49f3-8db5-b40407c7bbaa tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1682 microversion: 2.1 time: 0.152551 May 10 16:58:38.660496 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 463/956] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:38 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:39.517108 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-e1fe233f-df41-4131-b57f-9433187d679d req-6e150ca6-4bab-45c6-8ecc-b31c3f199077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5391c0c-c286-47e5-9ad9-68018ba1a4f2", "name": "network-vif-deleted", "tag": "8d105744-57a6-46a3-8258-83bacd585f58"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:58:39.527442 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-e1fe233f-df41-4131-b57f-9433187d679d req-6e150ca6-4bab-45c6-8ecc-b31c3f199077 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:39.528191 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-e1fe233f-df41-4131-b57f-9433187d679d req-6e150ca6-4bab-45c6-8ecc-b31c3f199077 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:39.541340 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-e1fe233f-df41-4131-b57f-9433187d679d req-6e150ca6-4bab-45c6-8ecc-b31c3f199077 service nova] Creating event network-vif-deleted:8d105744-57a6-46a3-8258-83bacd585f58 for instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 on hv-cinder-83588 May 10 16:58:39.546488 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-e1fe233f-df41-4131-b57f-9433187d679d req-6e150ca6-4bab-45c6-8ecc-b31c3f199077 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121413 May 10 16:58:39.547358 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 494/957] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:58:39.678142 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:39.678976 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:39.685635 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:39.686083 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:39.686867 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:39.687303 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:39.722768 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:39.723282 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:39.723682 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lazy-loading 'fault' on Instance uuid f5391c0c-c286-47e5-9ad9-68018ba1a4f2 {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:58:39.769871 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69585611ca7547adb43378445b4f1521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46a3e1f43434294a8e3d1ef8c04061b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:58:39.772940 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-09f9ee0f-ac10-4add-8f30-8437c40aba3e tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 200 len: 1331 microversion: 2.1 time: 0.098956 May 10 16:58:39.773613 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 464/958] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:39 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:58:40.791989 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3d104f1c-fe77-4373-80eb-6cf9c22fcbe2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:40.792726 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3d104f1c-fe77-4373-80eb-6cf9c22fcbe2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:40.800537 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3d104f1c-fe77-4373-80eb-6cf9c22fcbe2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:40.801014 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3d104f1c-fe77-4373-80eb-6cf9c22fcbe2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:40.801808 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3d104f1c-fe77-4373-80eb-6cf9c22fcbe2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:40.802249 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3d104f1c-fe77-4373-80eb-6cf9c22fcbe2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:40.817499 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-3d104f1c-fe77-4373-80eb-6cf9c22fcbe2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3d104f1c-fe77-4373-80eb-6cf9c22fcbe2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 HTTP/1.1 May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:58:40.819202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:40.820950 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'f5391c0c-c286-47e5-9ad9-68018ba1a4f2'} May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:58:40.821864 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:40.823380 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:40.824798 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3d104f1c-fe77-4373-80eb-6cf9c22fcbe2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:58:40.824798 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3d104f1c-fe77-4373-80eb-6cf9c22fcbe2 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 404 len: 111 microversion: 2.1 time: 0.033320 May 10 16:58:40.824798 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 495/959] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:40 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:58:40.832076 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0eb4e484-0a90-44d1-bf6c-cdf0ea5a81e0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '.version_select at 0x7f5fb6a37040>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:40.853930 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0eb4e484-0a90-44d1-bf6c-cdf0ea5a81e0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122536131" status: 202 len: 0 microversion: 2.1 time: 0.027773 May 10 16:58:40.854522 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 465/960] 10.222.0.48 () {58 vars in 1220 bytes} [Tue May 10 16:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122536131 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:58:42.664425 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-52117ca4-ee5a-4266-918d-25d9829c57c5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:42.664948 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-52117ca4-ee5a-4266-918d-25d9829c57c5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:42.671234 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-52117ca4-ee5a-4266-918d-25d9829c57c5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:42.671685 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-52117ca4-ee5a-4266-918d-25d9829c57c5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:42.672492 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-52117ca4-ee5a-4266-918d-25d9829c57c5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:42.672934 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-52117ca4-ee5a-4266-918d-25d9829c57c5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:42.686306 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-52117ca4-ee5a-4266-918d-25d9829c57c5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-52117ca4-ee5a-4266-918d-25d9829c57c5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: DELETE /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 HTTP/1.1 May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:58:42.687859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:42.689995 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'f5391c0c-c286-47e5-9ad9-68018ba1a4f2'} May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:58:42.691202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:42.693189 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:42.694833 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-52117ca4-ee5a-4266-918d-25d9829c57c5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:58:42.694833 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-52117ca4-ee5a-4266-918d-25d9829c57c5 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 404 len: 111 microversion: 2.1 time: 0.029243 May 10 16:58:42.694833 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 496/961] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:58:42 2022] DELETE /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:58:42.706870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b8e37aa3-f47f-46dc-9d18-93682fa8833a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:42.707587 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b8e37aa3-f47f-46dc-9d18-93682fa8833a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: f5391c0c-c286-47e5-9ad9-68018ba1a4f2] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:42.714435 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b8e37aa3-f47f-46dc-9d18-93682fa8833a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:42.714889 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b8e37aa3-f47f-46dc-9d18-93682fa8833a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:42.715703 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b8e37aa3-f47f-46dc-9d18-93682fa8833a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:42.716119 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b8e37aa3-f47f-46dc-9d18-93682fa8833a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:42.733278 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-b8e37aa3-f47f-46dc-9d18-93682fa8833a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b8e37aa3-f47f-46dc-9d18-93682fa8833a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 HTTP/1.1 May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:58:42.734935 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:42.736999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': 'f5391c0c-c286-47e5-9ad9-68018ba1a4f2'} May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:58:42.737740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. May 10 16:58:42.739324 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:42.740598 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b8e37aa3-f47f-46dc-9d18-93682fa8833a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance f5391c0c-c286-47e5-9ad9-68018ba1a4f2 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:58:42.740598 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b8e37aa3-f47f-46dc-9d18-93682fa8833a tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2" status: 404 len: 111 microversion: 2.1 time: 0.040065 May 10 16:58:42.740598 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 466/962] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:42 2022] GET /compute/v2.1/servers/f5391c0c-c286-47e5-9ad9-68018ba1a4f2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:58:43.877076 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e869b427-91cc-4a9c-901e-b91631cea2c0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:43.877657 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e869b427-91cc-4a9c-901e-b91631cea2c0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:43.884035 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e869b427-91cc-4a9c-901e-b91631cea2c0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:43.884544 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e869b427-91cc-4a9c-901e-b91631cea2c0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:43.885331 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e869b427-91cc-4a9c-901e-b91631cea2c0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:43.885763 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e869b427-91cc-4a9c-901e-b91631cea2c0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:43.900487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-e869b427-91cc-4a9c-901e-b91631cea2c0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e869b427-91cc-4a9c-901e-b91631cea2c0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: DELETE /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 HTTP/1.1 May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:58:43.902002 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:58:43.903720 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '4c190231-eceb-49d6-a1e0-c8fff5d68042'} May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:58:43.904678 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:58:43.906251 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:43.907778 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e869b427-91cc-4a9c-901e-b91631cea2c0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:58:43.907778 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e869b427-91cc-4a9c-901e-b91631cea2c0 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 404 len: 111 microversion: 2.1 time: 0.030868 May 10 16:58:43.907778 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 497/963] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:58:43 2022] DELETE /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:58:43.912048 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-eb19b844-0f87-49aa-960d-3983a660a6ac tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:43.912711 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-eb19b844-0f87-49aa-960d-3983a660a6ac tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 4c190231-eceb-49d6-a1e0-c8fff5d68042] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:43.919115 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb19b844-0f87-49aa-960d-3983a660a6ac tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:43.919563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb19b844-0f87-49aa-960d-3983a660a6ac tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:43.920363 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb19b844-0f87-49aa-960d-3983a660a6ac tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:43.920793 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb19b844-0f87-49aa-960d-3983a660a6ac tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:43.935449 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-eb19b844-0f87-49aa-960d-3983a660a6ac tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-eb19b844-0f87-49aa-960d-3983a660a6ac tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 HTTP/1.1 May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:58:43.937121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:58:43.939344 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '4c190231-eceb-49d6-a1e0-c8fff5d68042'} May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:58:43.940300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. May 10 16:58:43.941748 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:43.943112 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-eb19b844-0f87-49aa-960d-3983a660a6ac tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance 4c190231-eceb-49d6-a1e0-c8fff5d68042 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:58:43.943112 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-eb19b844-0f87-49aa-960d-3983a660a6ac tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042" status: 404 len: 111 microversion: 2.1 time: 0.030359 May 10 16:58:43.943112 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 467/964] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:43 2022] GET /compute/v2.1/servers/4c190231-eceb-49d6-a1e0-c8fff5d68042 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:58:43.947793 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2d94ffec-ec6a-4120-8eca-7d1995da5a25 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:43.948314 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-2d94ffec-ec6a-4120-8eca-7d1995da5a25 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:43.954594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2d94ffec-ec6a-4120-8eca-7d1995da5a25 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:43.955013 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2d94ffec-ec6a-4120-8eca-7d1995da5a25 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:43.955796 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2d94ffec-ec6a-4120-8eca-7d1995da5a25 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:43.956234 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-2d94ffec-ec6a-4120-8eca-7d1995da5a25 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:43.970215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-2d94ffec-ec6a-4120-8eca-7d1995da5a25 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2d94ffec-ec6a-4120-8eca-7d1995da5a25 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: DELETE /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 HTTP/1.1 May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:58:43.971825 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:58:43.973468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '5d50ae65-a922-42f2-8db1-87b59ed66282'} May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:58:43.974341 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:58:43.975586 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:43.976847 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-2d94ffec-ec6a-4120-8eca-7d1995da5a25 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:58:43.976847 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-2d94ffec-ec6a-4120-8eca-7d1995da5a25 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 404 len: 111 microversion: 2.1 time: 0.029413 May 10 16:58:43.976847 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 498/965] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:58:43 2022] DELETE /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:58:43.981805 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7dcaf111-32db-4ade-ae63-0ad35417b843 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:43.982410 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-7dcaf111-32db-4ade-ae63-0ad35417b843 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 5d50ae65-a922-42f2-8db1-87b59ed66282] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:43.989389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7dcaf111-32db-4ade-ae63-0ad35417b843 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:43.989863 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7dcaf111-32db-4ade-ae63-0ad35417b843 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:43.990608 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7dcaf111-32db-4ade-ae63-0ad35417b843 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:43.991047 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-7dcaf111-32db-4ade-ae63-0ad35417b843 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:44.005531 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-7dcaf111-32db-4ade-ae63-0ad35417b843 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7dcaf111-32db-4ade-ae63-0ad35417b843 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 HTTP/1.1 May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:58:44.007046 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:58:44.008814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '5d50ae65-a922-42f2-8db1-87b59ed66282'} May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:58:44.009707 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. May 10 16:58:44.011193 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:44.012490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-7dcaf111-32db-4ade-ae63-0ad35417b843 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance 5d50ae65-a922-42f2-8db1-87b59ed66282 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:58:44.012490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-7dcaf111-32db-4ade-ae63-0ad35417b843 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282" status: 404 len: 111 microversion: 2.1 time: 0.030500 May 10 16:58:44.012490 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 468/966] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:43 2022] GET /compute/v2.1/servers/5d50ae65-a922-42f2-8db1-87b59ed66282 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:58:45.151343 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-399fd2ab-1bc7-4610-b2be-9b7a5a20e026 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:45.151925 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-399fd2ab-1bc7-4610-b2be-9b7a5a20e026 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:45.159415 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-399fd2ab-1bc7-4610-b2be-9b7a5a20e026 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:45.159873 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-399fd2ab-1bc7-4610-b2be-9b7a5a20e026 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:45.160710 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-399fd2ab-1bc7-4610-b2be-9b7a5a20e026 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:45.161311 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-399fd2ab-1bc7-4610-b2be-9b7a5a20e026 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:45.181202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-399fd2ab-1bc7-4610-b2be-9b7a5a20e026 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-399fd2ab-1bc7-4610-b2be-9b7a5a20e026 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: DELETE /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 HTTP/1.1 May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:58:45.183752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:58:45.185570 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '94042c88-ecb2-484f-8a2c-df1d0ecae7a6'} May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:58:45.186433 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:58:45.187880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:45.190205 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-399fd2ab-1bc7-4610-b2be-9b7a5a20e026 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:58:45.190205 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-399fd2ab-1bc7-4610-b2be-9b7a5a20e026 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "DELETE /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 404 len: 111 microversion: 2.1 time: 0.037922 May 10 16:58:45.190205 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 499/967] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 16:58:45 2022] DELETE /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:58:45.194966 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e740b8c4-e25d-46a3-918a-cc57fc8880c1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:45.195573 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e740b8c4-e25d-46a3-918a-cc57fc8880c1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] [instance: 94042c88-ecb2-484f-8a2c-df1d0ecae7a6] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:58:45.203147 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e740b8c4-e25d-46a3-918a-cc57fc8880c1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:45.203604 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e740b8c4-e25d-46a3-918a-cc57fc8880c1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:45.205116 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e740b8c4-e25d-46a3-918a-cc57fc8880c1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:58:45.205664 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e740b8c4-e25d-46a3-918a-cc57fc8880c1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:58:45.220872 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-e740b8c4-e25d-46a3-918a-cc57fc8880c1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] HTTP exception thrown: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e740b8c4-e25d-46a3-918a-cc57fc8880c1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Request method failure captured: May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 HTTP/1.1 May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepjO1ZmWzN1WRbkH-WznYsVG8hprqPCWqvIHUMoqLxnjL53xC_gY3QBB9hOQknZNOxMF4W2bd6uZ8xZimr-fur4D4YRF5KOx-a1TD3AKnkHEyToLBKDw9FYtW-jnrCGNcBS3KjV9hQwMQ5imwd7HokJLCp8bOaVl6lEbHBkCiK9nvMU May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 16:58:45.222509 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a46a3e1f43434294a8e3d1ef8c04061b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: a46a3e1f43434294a8e3d1ef8c04061b May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2143769197 May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: 69585611ca7547adb43378445b4f1521 May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-AttachVolumeNegativeTest-2143769197-project May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:58:45.224544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '94042c88-ecb2-484f-8a2c-df1d0ecae7a6'} May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:58:45.225660 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. May 10 16:58:45.227689 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 16:58:45.230641 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e740b8c4-e25d-46a3-918a-cc57fc8880c1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] Returning 404 to user: Instance 94042c88-ecb2-484f-8a2c-df1d0ecae7a6 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:58:45.230641 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e740b8c4-e25d-46a3-918a-cc57fc8880c1 tempest-AttachVolumeNegativeTest-2143769197 tempest-AttachVolumeNegativeTest-2143769197-project] 10.222.0.48 "GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6" status: 404 len: 111 microversion: 2.1 time: 0.032855 May 10 16:58:45.230641 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 469/968] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:58:45 2022] GET /compute/v2.1/servers/94042c88-ecb2-484f-8a2c-df1d0ecae7a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:58:49.986785 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5f10c3a2-bb53-4360-a5f9-e9c7e8ad8220 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] Action: 'create', calling method: .version_select at 0x7f5fbfeb6d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-349109637", "metadata": {"Type": "work"}}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:58:50.270862 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5f10c3a2-bb53-4360-a5f9-e9c7e8ad8220 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.393647 May 10 16:58:50.271475 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 500/969] 10.222.0.48 () {60 vars in 1155 bytes} [Tue May 10 16:58:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 395 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 16:58:50.282374 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c85c20e1-b7b0-4f55-bdf0-3432b53283f6 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] Calling method '.version_select at 0x7f5fb69cab80>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:50.334433 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c85c20e1-b7b0-4f55-bdf0-3432b53283f6 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea" status: 200 len: 352 microversion: 2.1 time: 0.055984 May 10 16:58:50.335073 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 470/970] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:58:50 2022] GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:58:51.346828 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4f9e11b5-0543-4233-b877-355319a44ce7 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] Calling method '.version_select at 0x7f5fb6549a60>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:51.395695 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4f9e11b5-0543-4233-b877-355319a44ce7 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea" status: 200 len: 353 microversion: 2.1 time: 0.053377 May 10 16:58:51.396293 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 501/971] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:58:51 2022] GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:58:51.407502 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-65af3779-fcac-46d6-8ccc-cb57f1922a78 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] Calling method '.version_select at 0x7f5fb6a37040>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:51.453688 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-65af3779-fcac-46d6-8ccc-cb57f1922a78 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea" status: 200 len: 353 microversion: 2.1 time: 0.050386 May 10 16:58:51.454286 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 471/972] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:58:51 2022] GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:58:51.470850 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9fc5549b-cfab-47ee-a65d-fbd290fb23ce tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] Calling method '.version_select at 0x7f5fb636e790>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:51.531795 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9fc5549b-cfab-47ee-a65d-fbd290fb23ce tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea" status: 202 len: 0 microversion: 2.1 time: 0.064337 May 10 16:58:51.532396 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 502/973] 10.222.0.48 () {58 vars in 1247 bytes} [Tue May 10 16:58:51 2022] DELETE /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:58:51.540550 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-0ff05f46-e6b0-431d-92c5-14c71a2b4e91 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] Calling method '.version_select at 0x7f5fb69ca5e0>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:51.589489 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-0ff05f46-e6b0-431d-92c5-14c71a2b4e91 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea" status: 200 len: 352 microversion: 2.1 time: 0.052711 May 10 16:58:51.590068 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 472/974] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:58:51 2022] GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:58:52.602202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-99df0ae9-8a2b-44c2-81fc-40d022bd03d8 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] Calling method '.version_select at 0x7f5fb63bbaf0>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-99df0ae9-8a2b-44c2-81fc-40d022bd03d8 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] HTTP exception thrown: Volume d7975e54-3e79-474e-9b77-8df4faabf2ea could not be found. May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-99df0ae9-8a2b-44c2-81fc-40d022bd03d8 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] Request method failure captured: May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea HTTP/1.1 May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepnJh2BJh2zqWYnXqkteJleIKUtDru0fFTyRHxAI4MF28C65AdhBfbgzo8lAIZLlDTGXggDeYLUB16Pprp78SCNIQXB24uNba2NgH9i-N9eclwPzkjLCJL07d0caE0Qy_VzXyzJd4zq7dnGiqGYyxn1ZLShphFQjifkiu6v2S8faWqc May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 769fd5ac992a47e0afd3996ef9786b70 May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-VolumesGetTestJSON-1953534289 May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 16:58:52.632241 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/769fd5ac992a47e0afd3996ef9786b70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/769fd5ac992a47e0afd3996ef9786b70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/769fd5ac992a47e0afd3996ef9786b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_769fd5ac992a47e0afd3996ef9786b70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-VolumesGetTestJSON-1953534289 May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 769fd5ac992a47e0afd3996ef9786b70 May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-VolumesGetTestJSON-1953534289 May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-VolumesGetTestJSON-1953534289-project May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 1ea0e2983fca43819e432a19e6ea2b11 May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-VolumesGetTestJSON-1953534289-project May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Volume d7975e54-3e79-474e-9b77-8df4faabf2ea could not be found. May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': 'd7975e54-3e79-474e-9b77-8df4faabf2ea'} May 10 16:58:52.634976 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d7975e54-3e79-474e-9b77-8df4faabf2ea could not be found. (HTTP 404) (Request-ID: req-d43e2a6c-fdf9-4c4a-9170-b2fe2473f206) May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:52.636019 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:58:52.637644 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d7975e54-3e79-474e-9b77-8df4faabf2ea could not be found. May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 16:58:52.639215 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d7975e54-3e79-474e-9b77-8df4faabf2ea could not be found. May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d7975e54-3e79-474e-9b77-8df4faabf2ea could not be found. May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-99df0ae9-8a2b-44c2-81fc-40d022bd03d8 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] Returning 404 to user: Volume d7975e54-3e79-474e-9b77-8df4faabf2ea could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-99df0ae9-8a2b-44c2-81fc-40d022bd03d8 tempest-VolumesGetTestJSON-1953534289 tempest-VolumesGetTestJSON-1953534289-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea" status: 404 len: 109 microversion: 2.1 time: 0.034763 May 10 16:58:52.641127 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 503/975] 10.222.0.48 () {58 vars in 1244 bytes} [Tue May 10 16:58:52 2022] GET /compute/v2.1/os-volumes/d7975e54-3e79-474e-9b77-8df4faabf2ea => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:59:13.703526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-692ddd58-d428-46c5-8808-144f1b4c46eb tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Action: 'create', calling method: .version_select at 0x7f5fb6a37b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1856568238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFKUT+SzS5/P4ydIOtvuzMzkkfTapQ60T4+HEbvi00WDGerx27VYibZfMyxpXCMskPJmg30DXzAP7nobzKQFRkLxxpYiZG8lRDqg4IG1IVE0MFOVbvySqmb8ExugnxShA=="}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:59:13.722957 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-692ddd58-d428-46c5-8808-144f1b4c46eb tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Getting quotas for project 4ca9807e934c4826bb948e391d7a315a. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:59:13.730200 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-692ddd58-d428-46c5-8808-144f1b4c46eb tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Getting quotas for user 5fafb32dcef84cc7be2399905c2611c1 and project 4ca9807e934c4826bb948e391d7a315a. Resources: {'key_pairs'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:59:13.766309 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-692ddd58-d428-46c5-8808-144f1b4c46eb tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.277232 May 10 16:59:13.767405 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 473/976] 10.222.0.48 () {60 vars in 1158 bytes} [Tue May 10 16:59:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:59:28.916816 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-507664089", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1856568238", "security_groups": [{"name": "tempest-secgroup-smoke-20001153"}], "networks": [{"uuid": "aa44f7bd-8c99-4236-a728-89a387b3d6df"}], "block_device_mapping_v2": [{"uuid": "7135113d-2efd-4fce-b7db-6be1c31faed4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:59:29.027844 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.network.neutron [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] validate_networks() for [('aa44f7bd-8c99-4236-a728-89a387b3d6df', None, None, None, None, None)] {{(pid=134195) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:59:29.427311 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Flavor limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:59:29.427734 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Image limits 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:59:29.428197 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Flavor pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:59:29.428625 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Image pref 0:0:0 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:59:29.429026 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.virt.hardware [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134195) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:59:29.437555 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:29.438000 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:29.438792 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:29.439247 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:29.456121 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Getting quotas for project 4ca9807e934c4826bb948e391d7a315a. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:59:29.460141 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.quota [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Getting quotas for user 5fafb32dcef84cc7be2399905c2611c1 and project 4ca9807e934c4826bb948e391d7a315a. Resources: {'instances', 'cores', 'ram'} {{(pid=134195) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:59:29.514835 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Going to run 1 instances... {{(pid=134195) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:59:29.516922 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7135113d-2efd-4fce-b7db-6be1c31faed4',volume_size=None,volume_type=None)] {{(pid=134195) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:59:29.650395 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-407cdab0-0512-4a90-85d6-6c39538f2142 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.739297 May 10 16:59:29.651074 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 504/977] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:59:28 2022] POST /compute/v2.1/servers => generated 404 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:59:29.662464 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-10037e04-8349-4b70-89b1-01dd5aa01332 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:29.663078 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-10037e04-8349-4b70-89b1-01dd5aa01332 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:29.717446 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-10037e04-8349-4b70-89b1-01dd5aa01332 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:29.725270 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-10037e04-8349-4b70-89b1-01dd5aa01332 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1088 microversion: 2.1 time: 0.068041 May 10 16:59:29.725845 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 474/978] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:29 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:30.743324 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-97705e71-8976-4701-8a13-5c7a1b403c6d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:30.743937 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-97705e71-8976-4701-8a13-5c7a1b403c6d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:30.750828 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97705e71-8976-4701-8a13-5c7a1b403c6d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:30.751282 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97705e71-8976-4701-8a13-5c7a1b403c6d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:30.752048 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97705e71-8976-4701-8a13-5c7a1b403c6d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:30.752515 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-97705e71-8976-4701-8a13-5c7a1b403c6d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:30.819221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-97705e71-8976-4701-8a13-5c7a1b403c6d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:30.826816 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-97705e71-8976-4701-8a13-5c7a1b403c6d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1204 microversion: 2.1 time: 0.087312 May 10 16:59:30.827460 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 505/979] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:30 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:31.844848 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c85bd4f5-e32b-4fde-a184-a9b4b73f522c tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:31.845456 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c85bd4f5-e32b-4fde-a184-a9b4b73f522c tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:31.852504 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c85bd4f5-e32b-4fde-a184-a9b4b73f522c tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:31.852811 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c85bd4f5-e32b-4fde-a184-a9b4b73f522c tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:31.853815 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c85bd4f5-e32b-4fde-a184-a9b4b73f522c tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:31.854199 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c85bd4f5-e32b-4fde-a184-a9b4b73f522c tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:31.919743 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-a96d9b33-3734-41ae-b97c-defc4e73ca74 req-9135dc66-b6d1-48a1-9e31-5509732b3424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac", "tag": "7a105162-f20d-4ee9-a4ae-56c05650a65d"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:59:31.932398 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-a96d9b33-3734-41ae-b97c-defc4e73ca74 req-9135dc66-b6d1-48a1-9e31-5509732b3424 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:31.933140 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-a96d9b33-3734-41ae-b97c-defc4e73ca74 req-9135dc66-b6d1-48a1-9e31-5509732b3424 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:31.946762 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-a96d9b33-3734-41ae-b97c-defc4e73ca74 req-9135dc66-b6d1-48a1-9e31-5509732b3424 service nova] Creating event network-changed:7a105162-f20d-4ee9-a4ae-56c05650a65d for instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac on hv-cinder-83588 May 10 16:59:31.956850 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-a96d9b33-3734-41ae-b97c-defc4e73ca74 req-9135dc66-b6d1-48a1-9e31-5509732b3424 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040964 May 10 16:59:31.958035 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 506/980] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:59:32.014947 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c85bd4f5-e32b-4fde-a184-a9b4b73f522c tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:32.024233 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c85bd4f5-e32b-4fde-a184-a9b4b73f522c tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1258 microversion: 2.1 time: 0.183099 May 10 16:59:32.024859 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 475/981] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:31 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:33.041926 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5a331ce5-f61d-4912-96e9-1ef0518010ca tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:33.042627 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-5a331ce5-f61d-4912-96e9-1ef0518010ca tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:33.049254 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a331ce5-f61d-4912-96e9-1ef0518010ca tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:33.049713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a331ce5-f61d-4912-96e9-1ef0518010ca tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:33.050494 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a331ce5-f61d-4912-96e9-1ef0518010ca tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:33.052058 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5a331ce5-f61d-4912-96e9-1ef0518010ca tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:33.182567 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5a331ce5-f61d-4912-96e9-1ef0518010ca tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:33.189788 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5a331ce5-f61d-4912-96e9-1ef0518010ca tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1258 microversion: 2.1 time: 0.152221 May 10 16:59:33.190363 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 507/982] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:33 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:34.206825 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2907206b-131b-4962-bf12-0a9b8de774e1 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:34.208047 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2907206b-131b-4962-bf12-0a9b8de774e1 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:34.214389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2907206b-131b-4962-bf12-0a9b8de774e1 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:34.214841 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2907206b-131b-4962-bf12-0a9b8de774e1 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:34.215605 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2907206b-131b-4962-bf12-0a9b8de774e1 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:34.216042 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2907206b-131b-4962-bf12-0a9b8de774e1 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:34.345321 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2907206b-131b-4962-bf12-0a9b8de774e1 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:34.352892 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2907206b-131b-4962-bf12-0a9b8de774e1 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1258 microversion: 2.1 time: 0.149911 May 10 16:59:34.353449 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 476/983] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:34 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:35.369683 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-5d3556bc-a251-4938-8247-16f5e6b69339 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:35.370291 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-5d3556bc-a251-4938-8247-16f5e6b69339 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:35.376641 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5d3556bc-a251-4938-8247-16f5e6b69339 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:35.377087 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5d3556bc-a251-4938-8247-16f5e6b69339 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:35.377845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5d3556bc-a251-4938-8247-16f5e6b69339 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:35.378274 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-5d3556bc-a251-4938-8247-16f5e6b69339 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:35.510704 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-5d3556bc-a251-4938-8247-16f5e6b69339 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:35.518055 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-5d3556bc-a251-4938-8247-16f5e6b69339 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1258 microversion: 2.1 time: 0.152260 May 10 16:59:35.518618 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 508/984] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:35 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:36.535849 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-609e4413-63b4-4ef5-a0c9-c4490a76dc30 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:36.536635 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-609e4413-63b4-4ef5-a0c9-c4490a76dc30 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:36.542860 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-609e4413-63b4-4ef5-a0c9-c4490a76dc30 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:36.543310 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-609e4413-63b4-4ef5-a0c9-c4490a76dc30 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:36.544072 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-609e4413-63b4-4ef5-a0c9-c4490a76dc30 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:36.544542 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-609e4413-63b4-4ef5-a0c9-c4490a76dc30 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:36.684862 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-609e4413-63b4-4ef5-a0c9-c4490a76dc30 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:36.692500 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-609e4413-63b4-4ef5-a0c9-c4490a76dc30 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1258 microversion: 2.1 time: 0.160928 May 10 16:59:36.693074 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 477/985] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:36 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:37.709647 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-a0ba784f-8a11-4fd7-bada-3540c2b702ea tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:37.710571 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-a0ba784f-8a11-4fd7-bada-3540c2b702ea tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:37.717548 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a0ba784f-8a11-4fd7-bada-3540c2b702ea tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:37.718006 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a0ba784f-8a11-4fd7-bada-3540c2b702ea tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:37.718784 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a0ba784f-8a11-4fd7-bada-3540c2b702ea tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:37.719221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-a0ba784f-8a11-4fd7-bada-3540c2b702ea tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:37.849452 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-a0ba784f-8a11-4fd7-bada-3540c2b702ea tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:37.857044 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-a0ba784f-8a11-4fd7-bada-3540c2b702ea tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1258 microversion: 2.1 time: 0.152003 May 10 16:59:37.857611 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 509/986] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:37 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:38.874533 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cec4aba6-e60a-42f6-a679-2bc31d9110f5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:38.875150 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cec4aba6-e60a-42f6-a679-2bc31d9110f5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:38.882100 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cec4aba6-e60a-42f6-a679-2bc31d9110f5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:38.882550 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cec4aba6-e60a-42f6-a679-2bc31d9110f5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:38.883318 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cec4aba6-e60a-42f6-a679-2bc31d9110f5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:38.883758 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cec4aba6-e60a-42f6-a679-2bc31d9110f5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:39.028231 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cec4aba6-e60a-42f6-a679-2bc31d9110f5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:39.035705 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cec4aba6-e60a-42f6-a679-2bc31d9110f5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1258 microversion: 2.1 time: 0.164951 May 10 16:59:39.036468 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 478/987] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:38 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:40.053811 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-02cedd9b-c666-42ab-9cfd-90cd0f35dd45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:40.054428 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-02cedd9b-c666-42ab-9cfd-90cd0f35dd45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:40.071132 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02cedd9b-c666-42ab-9cfd-90cd0f35dd45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:40.071594 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02cedd9b-c666-42ab-9cfd-90cd0f35dd45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:40.072559 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02cedd9b-c666-42ab-9cfd-90cd0f35dd45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:40.073045 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-02cedd9b-c666-42ab-9cfd-90cd0f35dd45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:40.219133 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-02cedd9b-c666-42ab-9cfd-90cd0f35dd45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:40.227174 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-02cedd9b-c666-42ab-9cfd-90cd0f35dd45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1258 microversion: 2.1 time: 0.178455 May 10 16:59:40.227745 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 510/988] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:40 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:41.244213 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-c66d6827-e5a4-4da0-ab8a-cf74c6731961 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:41.244842 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-c66d6827-e5a4-4da0-ab8a-cf74c6731961 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:41.251088 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c66d6827-e5a4-4da0-ab8a-cf74c6731961 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:41.251529 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c66d6827-e5a4-4da0-ab8a-cf74c6731961 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:41.252293 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c66d6827-e5a4-4da0-ab8a-cf74c6731961 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:41.252742 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-c66d6827-e5a4-4da0-ab8a-cf74c6731961 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:41.388958 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-c66d6827-e5a4-4da0-ab8a-cf74c6731961 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:41.396706 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-c66d6827-e5a4-4da0-ab8a-cf74c6731961 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1258 microversion: 2.1 time: 0.156324 May 10 16:59:41.397275 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 479/989] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:41 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:42.135869 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-c2938438-9b27-4bd6-beac-946341b9e45f req-f5b36aea-800f-4ccb-bddd-03b4e49415f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac", "name": "network-vif-plugged", "status": "completed", "tag": "7a105162-f20d-4ee9-a4ae-56c05650a65d"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:59:42.143876 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-c2938438-9b27-4bd6-beac-946341b9e45f req-f5b36aea-800f-4ccb-bddd-03b4e49415f9 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:42.144355 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-c2938438-9b27-4bd6-beac-946341b9e45f req-f5b36aea-800f-4ccb-bddd-03b4e49415f9 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:42.155426 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-c2938438-9b27-4bd6-beac-946341b9e45f req-f5b36aea-800f-4ccb-bddd-03b4e49415f9 service nova] Creating event network-vif-plugged:7a105162-f20d-4ee9-a4ae-56c05650a65d for instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac on hv-cinder-83588 May 10 16:59:42.160524 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-c2938438-9b27-4bd6-beac-946341b9e45f req-f5b36aea-800f-4ccb-bddd-03b4e49415f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088680 May 10 16:59:42.161105 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 511/990] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:59:42.414185 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-eb084c11-489d-4d50-8547-1554a7967e6e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:42.415081 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-eb084c11-489d-4d50-8547-1554a7967e6e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:42.421286 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb084c11-489d-4d50-8547-1554a7967e6e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:42.421745 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb084c11-489d-4d50-8547-1554a7967e6e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:42.422526 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb084c11-489d-4d50-8547-1554a7967e6e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:42.422961 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-eb084c11-489d-4d50-8547-1554a7967e6e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:42.563276 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-eb084c11-489d-4d50-8547-1554a7967e6e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:42.571381 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-eb084c11-489d-4d50-8547-1554a7967e6e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1258 microversion: 2.1 time: 0.161884 May 10 16:59:42.571953 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 480/991] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:42 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:43.589080 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-bd73ced4-c684-4f51-89e2-791761f608e6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:43.589779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-bd73ced4-c684-4f51-89e2-791761f608e6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:43.595881 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd73ced4-c684-4f51-89e2-791761f608e6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:43.596366 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd73ced4-c684-4f51-89e2-791761f608e6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:43.597137 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd73ced4-c684-4f51-89e2-791761f608e6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:43.597635 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd73ced4-c684-4f51-89e2-791761f608e6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:43.744155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bd73ced4-c684-4f51-89e2-791761f608e6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:43.751605 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-bd73ced4-c684-4f51-89e2-791761f608e6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1441 microversion: 2.1 time: 0.167264 May 10 16:59:43.752171 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 512/992] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:43 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1441 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:43.767476 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-edf57fee-cea4-4845-b3b3-ba2961df7329 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:43.768091 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-edf57fee-cea4-4845-b3b3-ba2961df7329 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:43.774617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-edf57fee-cea4-4845-b3b3-ba2961df7329 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:43.775075 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-edf57fee-cea4-4845-b3b3-ba2961df7329 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:43.775851 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-edf57fee-cea4-4845-b3b3-ba2961df7329 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:43.776311 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-edf57fee-cea4-4845-b3b3-ba2961df7329 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:43.906245 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-edf57fee-cea4-4845-b3b3-ba2961df7329 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:43.916493 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-edf57fee-cea4-4845-b3b3-ba2961df7329 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1441 microversion: 2.1 time: 0.152758 May 10 16:59:43.917079 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 481/993] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:43 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1441 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:45.652200 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-82d15396-76c2-4eb8-b09a-7cd38bab8e1c req-c2b8010b-eba3-4de2-bd5e-f356cc40e1ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac", "tag": "7a105162-f20d-4ee9-a4ae-56c05650a65d"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:59:45.661421 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-82d15396-76c2-4eb8-b09a-7cd38bab8e1c req-c2b8010b-eba3-4de2-bd5e-f356cc40e1ae service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:45.661865 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-82d15396-76c2-4eb8-b09a-7cd38bab8e1c req-c2b8010b-eba3-4de2-bd5e-f356cc40e1ae service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:45.672604 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-82d15396-76c2-4eb8-b09a-7cd38bab8e1c req-c2b8010b-eba3-4de2-bd5e-f356cc40e1ae service nova] Creating event network-changed:7a105162-f20d-4ee9-a4ae-56c05650a65d for instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac on hv-cinder-83588 May 10 16:59:45.679431 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-82d15396-76c2-4eb8-b09a-7cd38bab8e1c req-c2b8010b-eba3-4de2-bd5e-f356cc40e1ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031445 May 10 16:59:45.680078 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 513/994] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:59:56.804164 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1687161084", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-578502746", "security_groups": [{"name": "tempest-secgroup-smoke-1747529592"}], "block_device_mapping_v2": [{"uuid": "2495f2a2-49b5-41c3-83c1-0806584524ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4630e6fb-ee22-4d27-bd44-871c41a7cdec"}]}} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:59:56.912672 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.network.neutron [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] validate_networks() for [('4630e6fb-ee22-4d27-bd44-871c41a7cdec', None, None, None, None, None)] {{(pid=134194) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:59:57.327794 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Flavor limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:59:57.328218 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Image limits 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:59:57.328724 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Flavor pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:59:57.329129 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Image pref 0:0:0 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:59:57.329544 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.virt.hardware [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:59:57.338975 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:57.339361 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:57.340161 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:57.340624 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:57.356822 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Getting quotas for project 0b8348f4bffd44e7b0da6367a1011709. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:59:57.360715 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.quota [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Getting quotas for user fe1f5f6882eb4a9aa869ad32fbdb0d92 and project 0b8348f4bffd44e7b0da6367a1011709. Resources: {'instances', 'cores', 'ram'} {{(pid=134194) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:59:57.417853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Going to run 1 instances... {{(pid=134194) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:59:57.420010 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2495f2a2-49b5-41c3-83c1-0806584524ef',volume_size=None,volume_type=None)] {{(pid=134194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:59:57.542844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2dbe1ad1-5115-4ece-b70e-80f4c3ae62a8 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742711 May 10 16:59:57.543492 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 482/995] 10.222.0.48 () {60 vars in 1146 bytes} [Tue May 10 16:59:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:59:57.555302 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1ec876b6-e448-4198-ab48-6664e226f9fa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:57.556231 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1ec876b6-e448-4198-ab48-6664e226f9fa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:57.610128 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1ec876b6-e448-4198-ab48-6664e226f9fa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:57.616559 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1ec876b6-e448-4198-ab48-6664e226f9fa tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1094 microversion: 2.1 time: 0.066780 May 10 16:59:57.617797 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 514/996] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:57 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:58.634917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f5749bb6-5222-4483-8399-d11854126a39 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:58.635622 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f5749bb6-5222-4483-8399-d11854126a39 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:58.642276 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5749bb6-5222-4483-8399-d11854126a39 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:58.642725 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5749bb6-5222-4483-8399-d11854126a39 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:58.643497 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5749bb6-5222-4483-8399-d11854126a39 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:58.643928 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f5749bb6-5222-4483-8399-d11854126a39 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:58.709300 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f5749bb6-5222-4483-8399-d11854126a39 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:58.718018 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f5749bb6-5222-4483-8399-d11854126a39 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1210 microversion: 2.1 time: 0.088205 May 10 16:59:58.718591 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 483/997] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:58 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:59:59.735399 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-8cb6c895-6319-47f2-89d7-cb82700f208f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:59:59.736595 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-8cb6c895-6319-47f2-89d7-cb82700f208f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:59:59.745413 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8cb6c895-6319-47f2-89d7-cb82700f208f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:59.745880 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8cb6c895-6319-47f2-89d7-cb82700f208f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:59.746705 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8cb6c895-6319-47f2-89d7-cb82700f208f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:59:59.747333 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-8cb6c895-6319-47f2-89d7-cb82700f208f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:59:59.954008 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-8cb6c895-6319-47f2-89d7-cb82700f208f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:59:59.961464 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-8cb6c895-6319-47f2-89d7-cb82700f208f tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.230326 May 10 16:59:59.962049 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 515/998] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 16:59:59 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:00.001786 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-fbd6457b-9b8c-4041-8b01-3d89694fe462 req-9b5d2daa-a0e2-4378-b166-226ff4a757c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23394041-3e1c-45af-9d2d-a0c5efe417fe", "tag": "c10a401c-fec0-43d5-a690-aa3e883a0b82"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:00:00.012247 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-fbd6457b-9b8c-4041-8b01-3d89694fe462 req-9b5d2daa-a0e2-4378-b166-226ff4a757c8 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:00.013178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-fbd6457b-9b8c-4041-8b01-3d89694fe462 req-9b5d2daa-a0e2-4378-b166-226ff4a757c8 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:00.025310 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-fbd6457b-9b8c-4041-8b01-3d89694fe462 req-9b5d2daa-a0e2-4378-b166-226ff4a757c8 service nova] Creating event network-changed:c10a401c-fec0-43d5-a690-aa3e883a0b82 for instance 23394041-3e1c-45af-9d2d-a0c5efe417fe on hv-cinder-83588 May 10 17:00:00.030714 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-fbd6457b-9b8c-4041-8b01-3d89694fe462 req-9b5d2daa-a0e2-4378-b166-226ff4a757c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032962 May 10 17:00:00.031331 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 484/999] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 16:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:00:00.978624 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-1a70aff7-d5a0-4f76-a156-a86904fe192a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:00.979233 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-1a70aff7-d5a0-4f76-a156-a86904fe192a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:00.985821 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1a70aff7-d5a0-4f76-a156-a86904fe192a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:00.986283 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1a70aff7-d5a0-4f76-a156-a86904fe192a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:00.987070 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1a70aff7-d5a0-4f76-a156-a86904fe192a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:00.987514 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-1a70aff7-d5a0-4f76-a156-a86904fe192a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:01.296223 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-1a70aff7-d5a0-4f76-a156-a86904fe192a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:01.305221 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-1a70aff7-d5a0-4f76-a156-a86904fe192a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.330086 May 10 17:00:01.306000 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 516/1000] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:00 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:02.324243 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-97aca1a8-eac2-4aa3-8218-07e2f52309cb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:02.324957 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-97aca1a8-eac2-4aa3-8218-07e2f52309cb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:02.331044 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-97aca1a8-eac2-4aa3-8218-07e2f52309cb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:02.331489 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-97aca1a8-eac2-4aa3-8218-07e2f52309cb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:02.332255 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-97aca1a8-eac2-4aa3-8218-07e2f52309cb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:02.332704 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-97aca1a8-eac2-4aa3-8218-07e2f52309cb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:02.464213 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-97aca1a8-eac2-4aa3-8218-07e2f52309cb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:02.471421 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-97aca1a8-eac2-4aa3-8218-07e2f52309cb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.152482 May 10 17:00:02.471980 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 485/1001] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:02 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:03.488511 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4626120b-d716-424a-b63b-7d014afbf7cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:03.489156 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4626120b-d716-424a-b63b-7d014afbf7cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:03.496190 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4626120b-d716-424a-b63b-7d014afbf7cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:03.496674 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4626120b-d716-424a-b63b-7d014afbf7cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:03.497445 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4626120b-d716-424a-b63b-7d014afbf7cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:03.497885 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4626120b-d716-424a-b63b-7d014afbf7cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:03.626163 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4626120b-d716-424a-b63b-7d014afbf7cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:03.633905 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4626120b-d716-424a-b63b-7d014afbf7cd tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.149346 May 10 17:00:03.634487 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 517/1002] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:03 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:04.651409 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-56364a17-9bd0-4049-b434-2e8d42ee459a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:04.652019 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-56364a17-9bd0-4049-b434-2e8d42ee459a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:04.658389 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56364a17-9bd0-4049-b434-2e8d42ee459a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:04.658848 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56364a17-9bd0-4049-b434-2e8d42ee459a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:04.659638 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56364a17-9bd0-4049-b434-2e8d42ee459a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:04.660079 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-56364a17-9bd0-4049-b434-2e8d42ee459a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:04.795573 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-56364a17-9bd0-4049-b434-2e8d42ee459a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:04.803118 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-56364a17-9bd0-4049-b434-2e8d42ee459a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.156410 May 10 17:00:04.803687 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 486/1003] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:04 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:05.820426 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-ec2f55bb-59c3-4533-b5e5-4450ffdfc952 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:05.821175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-ec2f55bb-59c3-4533-b5e5-4450ffdfc952 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:05.827469 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ec2f55bb-59c3-4533-b5e5-4450ffdfc952 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:05.827925 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ec2f55bb-59c3-4533-b5e5-4450ffdfc952 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:05.828728 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ec2f55bb-59c3-4533-b5e5-4450ffdfc952 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:05.829171 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-ec2f55bb-59c3-4533-b5e5-4450ffdfc952 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:05.962176 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-ec2f55bb-59c3-4533-b5e5-4450ffdfc952 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:05.969532 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-ec2f55bb-59c3-4533-b5e5-4450ffdfc952 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.153170 May 10 17:00:05.970101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 518/1004] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:05 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:06.987115 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f3948ddc-2bf5-45a0-898b-1561a92b47b2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:06.987703 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f3948ddc-2bf5-45a0-898b-1561a92b47b2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:06.994237 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f3948ddc-2bf5-45a0-898b-1561a92b47b2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:06.994685 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f3948ddc-2bf5-45a0-898b-1561a92b47b2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:06.995441 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f3948ddc-2bf5-45a0-898b-1561a92b47b2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:06.995879 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f3948ddc-2bf5-45a0-898b-1561a92b47b2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:07.136575 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f3948ddc-2bf5-45a0-898b-1561a92b47b2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:07.143781 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f3948ddc-2bf5-45a0-898b-1561a92b47b2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.160640 May 10 17:00:07.144353 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 487/1005] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:06 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:08.161179 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-34304d79-5025-4e1a-9a2b-6812d69f4e3c tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:08.161805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-34304d79-5025-4e1a-9a2b-6812d69f4e3c tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:08.168591 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34304d79-5025-4e1a-9a2b-6812d69f4e3c tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:08.169050 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34304d79-5025-4e1a-9a2b-6812d69f4e3c tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:08.169838 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34304d79-5025-4e1a-9a2b-6812d69f4e3c tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:08.170278 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-34304d79-5025-4e1a-9a2b-6812d69f4e3c tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:08.302667 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-34304d79-5025-4e1a-9a2b-6812d69f4e3c tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:08.310758 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-34304d79-5025-4e1a-9a2b-6812d69f4e3c tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.153567 May 10 17:00:08.311327 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 519/1006] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:08 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:09.327353 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-ffc13cbc-793f-46b5-9e68-86389f9a665a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:09.328006 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-ffc13cbc-793f-46b5-9e68-86389f9a665a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:09.334400 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ffc13cbc-793f-46b5-9e68-86389f9a665a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:09.334852 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ffc13cbc-793f-46b5-9e68-86389f9a665a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:09.336258 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ffc13cbc-793f-46b5-9e68-86389f9a665a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:09.336693 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-ffc13cbc-793f-46b5-9e68-86389f9a665a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:09.470220 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-ffc13cbc-793f-46b5-9e68-86389f9a665a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:09.478680 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-ffc13cbc-793f-46b5-9e68-86389f9a665a tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.155162 May 10 17:00:09.479245 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 488/1007] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:09 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:10.273440 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-dc0aad8c-5add-4680-9072-e2704dd024bd req-2e17eb68-4450-4f51-8fb2-a86f69f74a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23394041-3e1c-45af-9d2d-a0c5efe417fe", "name": "network-vif-plugged", "status": "completed", "tag": "c10a401c-fec0-43d5-a690-aa3e883a0b82"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:00:10.283331 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-dc0aad8c-5add-4680-9072-e2704dd024bd req-2e17eb68-4450-4f51-8fb2-a86f69f74a63 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:10.283805 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-dc0aad8c-5add-4680-9072-e2704dd024bd req-2e17eb68-4450-4f51-8fb2-a86f69f74a63 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:10.295830 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-dc0aad8c-5add-4680-9072-e2704dd024bd req-2e17eb68-4450-4f51-8fb2-a86f69f74a63 service nova] Creating event network-vif-plugged:c10a401c-fec0-43d5-a690-aa3e883a0b82 for instance 23394041-3e1c-45af-9d2d-a0c5efe417fe on hv-cinder-83588 May 10 17:00:10.300986 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-dc0aad8c-5add-4680-9072-e2704dd024bd req-2e17eb68-4450-4f51-8fb2-a86f69f74a63 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031307 May 10 17:00:10.301615 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 520/1008] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 17:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:00:10.495813 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cd6c7c86-d361-4226-bb0d-aeb6394579ba tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:10.496501 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cd6c7c86-d361-4226-bb0d-aeb6394579ba tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:10.503091 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd6c7c86-d361-4226-bb0d-aeb6394579ba tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:10.503620 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd6c7c86-d361-4226-bb0d-aeb6394579ba tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:10.504433 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd6c7c86-d361-4226-bb0d-aeb6394579ba tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:10.504870 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cd6c7c86-d361-4226-bb0d-aeb6394579ba tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:10.636101 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cd6c7c86-d361-4226-bb0d-aeb6394579ba tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:10.643535 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cd6c7c86-d361-4226-bb0d-aeb6394579ba tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.152431 May 10 17:00:10.644098 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 489/1009] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:10 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:11.661569 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-19b81842-b924-4b8d-b6b7-ecf9dbfc37ed tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:11.662368 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-19b81842-b924-4b8d-b6b7-ecf9dbfc37ed tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:11.670466 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-19b81842-b924-4b8d-b6b7-ecf9dbfc37ed tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:11.670919 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-19b81842-b924-4b8d-b6b7-ecf9dbfc37ed tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:11.671741 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-19b81842-b924-4b8d-b6b7-ecf9dbfc37ed tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:11.672180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-19b81842-b924-4b8d-b6b7-ecf9dbfc37ed tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:11.810036 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-19b81842-b924-4b8d-b6b7-ecf9dbfc37ed tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:11.817388 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-19b81842-b924-4b8d-b6b7-ecf9dbfc37ed tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1266 microversion: 2.1 time: 0.160927 May 10 17:00:11.817961 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 521/1010] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:11 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:12.834511 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-298b536d-c836-4252-8ac9-1c6c08b68df3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:12.835084 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-298b536d-c836-4252-8ac9-1c6c08b68df3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:12.842067 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-298b536d-c836-4252-8ac9-1c6c08b68df3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:12.842523 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-298b536d-c836-4252-8ac9-1c6c08b68df3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:12.843293 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-298b536d-c836-4252-8ac9-1c6c08b68df3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:12.843735 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-298b536d-c836-4252-8ac9-1c6c08b68df3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:12.973326 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-298b536d-c836-4252-8ac9-1c6c08b68df3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:12.981288 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-298b536d-c836-4252-8ac9-1c6c08b68df3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1452 microversion: 2.1 time: 0.150736 May 10 17:00:12.981883 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 490/1011] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:12 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:12.997507 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-565bf0e7-d612-4f85-bd6a-6cfbe0e7c6f7 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:00:12.998124 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-565bf0e7-d612-4f85-bd6a-6cfbe0e7c6f7 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:00:13.004482 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-565bf0e7-d612-4f85-bd6a-6cfbe0e7c6f7 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:13.004941 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-565bf0e7-d612-4f85-bd6a-6cfbe0e7c6f7 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:13.005713 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-565bf0e7-d612-4f85-bd6a-6cfbe0e7c6f7 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:13.006153 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-565bf0e7-d612-4f85-bd6a-6cfbe0e7c6f7 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:13.132859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-565bf0e7-d612-4f85-bd6a-6cfbe0e7c6f7 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:00:13.140658 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-565bf0e7-d612-4f85-bd6a-6cfbe0e7c6f7 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1452 microversion: 2.1 time: 0.146924 May 10 17:00:13.141228 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 522/1012] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:00:12 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:00:14.767069 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-dad08702-1d86-4edb-8444-1e81f03f4664 req-75c1c560-5315-4bb6-aa7b-e4c3004e1316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23394041-3e1c-45af-9d2d-a0c5efe417fe", "tag": "c10a401c-fec0-43d5-a690-aa3e883a0b82"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:00:14.775964 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-dad08702-1d86-4edb-8444-1e81f03f4664 req-75c1c560-5315-4bb6-aa7b-e4c3004e1316 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:00:14.776533 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-dad08702-1d86-4edb-8444-1e81f03f4664 req-75c1c560-5315-4bb6-aa7b-e4c3004e1316 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:00:14.787343 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-dad08702-1d86-4edb-8444-1e81f03f4664 req-75c1c560-5315-4bb6-aa7b-e4c3004e1316 service nova] Creating event network-changed:c10a401c-fec0-43d5-a690-aa3e883a0b82 for instance 23394041-3e1c-45af-9d2d-a0c5efe417fe on hv-cinder-83588 May 10 17:00:14.793162 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-dad08702-1d86-4edb-8444-1e81f03f4664 req-75c1c560-5315-4bb6-aa7b-e4c3004e1316 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029815 May 10 17:00:14.793875 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 491/1013] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 17:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:01:34.335606 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:01:34.336408 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Tue May 10 17:01:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:01:43.366507 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-73f86571-bbcc-41cc-adcc-3abd0374fbf9 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:01:43.367101 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-73f86571-bbcc-41cc-adcc-3abd0374fbf9 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:43.373180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73f86571-bbcc-41cc-adcc-3abd0374fbf9 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:43.373661 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73f86571-bbcc-41cc-adcc-3abd0374fbf9 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:43.374444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73f86571-bbcc-41cc-adcc-3abd0374fbf9 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:43.374890 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-73f86571-bbcc-41cc-adcc-3abd0374fbf9 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:43.400100 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.objects.instance [None req-73f86571-bbcc-41cc-adcc-3abd0374fbf9 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lazy-loading 'flavor' on Instance uuid 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac {{(pid=134195) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:01:43.488468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-73f86571-bbcc-41cc-adcc-3abd0374fbf9 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "POST /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac/action" status: 202 len: 0 microversion: 2.1 time: 0.126372 May 10 17:01:43.489549 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 523/1014] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 17:01:43 2022] POST /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:01:43.501279 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-02caf213-d1f6-4cf1-8679-bafac64bdc45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:43.501866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-02caf213-d1f6-4cf1-8679-bafac64bdc45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:43.510634 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-02caf213-d1f6-4cf1-8679-bafac64bdc45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:43.511083 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-02caf213-d1f6-4cf1-8679-bafac64bdc45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:43.511860 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-02caf213-d1f6-4cf1-8679-bafac64bdc45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:43.512321 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-02caf213-d1f6-4cf1-8679-bafac64bdc45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:43.812746 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-02caf213-d1f6-4cf1-8679-bafac64bdc45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:43.820401 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-02caf213-d1f6-4cf1-8679-bafac64bdc45 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.325358 May 10 17:01:43.820969 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 492/1015] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:43 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:44.840118 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-cc62366e-b904-4f5b-9bfd-538fc8a71d62 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:44.840766 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-cc62366e-b904-4f5b-9bfd-538fc8a71d62 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:44.848395 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cc62366e-b904-4f5b-9bfd-538fc8a71d62 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:44.848855 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cc62366e-b904-4f5b-9bfd-538fc8a71d62 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:44.849649 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cc62366e-b904-4f5b-9bfd-538fc8a71d62 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:44.850092 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-cc62366e-b904-4f5b-9bfd-538fc8a71d62 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:45.070079 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-cc62366e-b904-4f5b-9bfd-538fc8a71d62 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:45.078374 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-cc62366e-b904-4f5b-9bfd-538fc8a71d62 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.243166 May 10 17:01:45.078967 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 524/1016] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:44 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:45.284587 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e82ded07-cc7e-411f-af26-65a04a378b8e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:45.285235 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e82ded07-cc7e-411f-af26-65a04a378b8e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:45.286132 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-57cac615-8273-45d4-a3c3-0a50b08ce189 req-c885947a-3f69-4f7e-a9e3-e8795c61b27d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23394041-3e1c-45af-9d2d-a0c5efe417fe", "tag": "c10a401c-fec0-43d5-a690-aa3e883a0b82"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:01:45.291712 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e82ded07-cc7e-411f-af26-65a04a378b8e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:45.292159 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e82ded07-cc7e-411f-af26-65a04a378b8e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:45.292984 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e82ded07-cc7e-411f-af26-65a04a378b8e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:45.293416 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e82ded07-cc7e-411f-af26-65a04a378b8e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:45.294964 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-57cac615-8273-45d4-a3c3-0a50b08ce189 req-c885947a-3f69-4f7e-a9e3-e8795c61b27d service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:45.294964 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-57cac615-8273-45d4-a3c3-0a50b08ce189 req-c885947a-3f69-4f7e-a9e3-e8795c61b27d service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:45.307280 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-57cac615-8273-45d4-a3c3-0a50b08ce189 req-c885947a-3f69-4f7e-a9e3-e8795c61b27d service nova] Creating event network-changed:c10a401c-fec0-43d5-a690-aa3e883a0b82 for instance 23394041-3e1c-45af-9d2d-a0c5efe417fe on hv-cinder-83588 May 10 17:01:45.313356 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-57cac615-8273-45d4-a3c3-0a50b08ce189 req-c885947a-3f69-4f7e-a9e3-e8795c61b27d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030790 May 10 17:01:45.314084 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 525/1017] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 17:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:01:45.321950 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e82ded07-cc7e-411f-af26-65a04a378b8e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:01:45.417681 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e82ded07-cc7e-411f-af26-65a04a378b8e tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "DELETE /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 204 len: 0 microversion: 2.1 time: 0.137386 May 10 17:01:45.418969 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 493/1018] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 17:01:45 2022] DELETE /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:01:45.429894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-bd4c1b55-af42-4a4b-a1a9-c6febb9ce789 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:45.430539 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-bd4c1b55-af42-4a4b-a1a9-c6febb9ce789 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:45.438223 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd4c1b55-af42-4a4b-a1a9-c6febb9ce789 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:45.438687 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd4c1b55-af42-4a4b-a1a9-c6febb9ce789 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:45.439498 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd4c1b55-af42-4a4b-a1a9-c6febb9ce789 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:45.439946 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-bd4c1b55-af42-4a4b-a1a9-c6febb9ce789 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:45.618572 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-bd4c1b55-af42-4a4b-a1a9-c6febb9ce789 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:45.627485 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-bd4c1b55-af42-4a4b-a1a9-c6febb9ce789 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1577 microversion: 2.1 time: 0.202110 May 10 17:01:45.628087 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 526/1019] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:45 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:46.099723 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-1b1a9dab-e6cd-4732-ad07-d299ded1ef86 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:46.100674 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-1b1a9dab-e6cd-4732-ad07-d299ded1ef86 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:46.109853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1b1a9dab-e6cd-4732-ad07-d299ded1ef86 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:46.110336 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1b1a9dab-e6cd-4732-ad07-d299ded1ef86 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:46.111275 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1b1a9dab-e6cd-4732-ad07-d299ded1ef86 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:46.111832 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-1b1a9dab-e6cd-4732-ad07-d299ded1ef86 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:46.270449 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-1b1a9dab-e6cd-4732-ad07-d299ded1ef86 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:46.278493 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-1b1a9dab-e6cd-4732-ad07-d299ded1ef86 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.184916 May 10 17:01:46.279077 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 494/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:46 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:46.646187 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-59eb660b-668f-460c-8ae4-e039cf8a209d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:46.646757 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-59eb660b-668f-460c-8ae4-e039cf8a209d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:46.653317 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-59eb660b-668f-460c-8ae4-e039cf8a209d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:46.653781 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-59eb660b-668f-460c-8ae4-e039cf8a209d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:46.655106 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-59eb660b-668f-460c-8ae4-e039cf8a209d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:46.655856 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-59eb660b-668f-460c-8ae4-e039cf8a209d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:46.868033 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-59eb660b-668f-460c-8ae4-e039cf8a209d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:46.876776 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-59eb660b-668f-460c-8ae4-e039cf8a209d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1577 microversion: 2.1 time: 0.234406 May 10 17:01:46.877531 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 527/1021] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:46 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:47.295120 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d847c57c-42eb-4da3-a10e-2e0427bff4ac tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:47.296435 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d847c57c-42eb-4da3-a10e-2e0427bff4ac tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:47.302937 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d847c57c-42eb-4da3-a10e-2e0427bff4ac tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:47.303388 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d847c57c-42eb-4da3-a10e-2e0427bff4ac tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:47.304463 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d847c57c-42eb-4da3-a10e-2e0427bff4ac tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:47.304902 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d847c57c-42eb-4da3-a10e-2e0427bff4ac tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:47.460123 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d847c57c-42eb-4da3-a10e-2e0427bff4ac tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:47.480153 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d847c57c-42eb-4da3-a10e-2e0427bff4ac tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.178556 May 10 17:01:47.480153 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 495/1022] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:47 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:47.500624 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-84de1fc3-6eea-4282-b124-58e7ee2554d6 req-c99e6ba5-d139-4918-a4d3-b838bd662f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23394041-3e1c-45af-9d2d-a0c5efe417fe", "name": "network-vif-deleted", "tag": "c10a401c-fec0-43d5-a690-aa3e883a0b82"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:01:47.511760 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-84de1fc3-6eea-4282-b124-58e7ee2554d6 req-c99e6ba5-d139-4918-a4d3-b838bd662f89 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:47.512214 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-84de1fc3-6eea-4282-b124-58e7ee2554d6 req-c99e6ba5-d139-4918-a4d3-b838bd662f89 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:47.528468 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-84de1fc3-6eea-4282-b124-58e7ee2554d6 req-c99e6ba5-d139-4918-a4d3-b838bd662f89 service nova] Creating event network-vif-deleted:c10a401c-fec0-43d5-a690-aa3e883a0b82 for instance 23394041-3e1c-45af-9d2d-a0c5efe417fe on hv-cinder-83588 May 10 17:01:47.535028 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-84de1fc3-6eea-4282-b124-58e7ee2554d6 req-c99e6ba5-d139-4918-a4d3-b838bd662f89 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038533 May 10 17:01:47.535650 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 528/1023] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 17:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:01:47.898419 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:47.899656 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:47.909355 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:47.909696 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:47.911183 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:47.911857 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:47.948543 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:47.948999 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:47.949452 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lazy-loading 'fault' on Instance uuid 23394041-3e1c-45af-9d2d-a0c5efe417fe {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:01:47.992173 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:47.999958 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a943d98c-6ae8-4f2c-95ac-a6076a3724e2 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 200 len: 1230 microversion: 2.1 time: 0.108735 May 10 17:01:48.000569 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 496/1024] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:47 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:48.491227 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-902d4a3d-e47f-4f86-8083-1acb42fd2b2d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:48.491838 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-902d4a3d-e47f-4f86-8083-1acb42fd2b2d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:48.499376 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-902d4a3d-e47f-4f86-8083-1acb42fd2b2d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:48.499822 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-902d4a3d-e47f-4f86-8083-1acb42fd2b2d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:48.500655 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-902d4a3d-e47f-4f86-8083-1acb42fd2b2d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:48.501083 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-902d4a3d-e47f-4f86-8083-1acb42fd2b2d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:48.642441 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-902d4a3d-e47f-4f86-8083-1acb42fd2b2d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:48.650155 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-902d4a3d-e47f-4f86-8083-1acb42fd2b2d tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.163233 May 10 17:01:48.650748 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 529/1025] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:48 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:49.018700 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-daf6d8c3-d249-490a-9975-239c773edc31 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:49.019348 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-daf6d8c3-d249-490a-9975-239c773edc31 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 23394041-3e1c-45af-9d2d-a0c5efe417fe] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:49.026042 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-daf6d8c3-d249-490a-9975-239c773edc31 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:49.026495 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-daf6d8c3-d249-490a-9975-239c773edc31 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:49.027288 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-daf6d8c3-d249-490a-9975-239c773edc31 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:49.027737 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-daf6d8c3-d249-490a-9975-239c773edc31 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:49.043115 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-daf6d8c3-d249-490a-9975-239c773edc31 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] HTTP exception thrown: Instance 23394041-3e1c-45af-9d2d-a0c5efe417fe could not be found. May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-daf6d8c3-d249-490a-9975-239c773edc31 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Request method failure captured: May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe HTTP/1.1 May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepjwXWkcZx8fdNuIhlagIKAe2rPPbeB7-tsPIBcLhVhRwOgv69uzq7zmpdwHxuDIbAht7CyNKaYaHfWnwzFWL6i1UfuV8qzsE6QL43t4eRPSyDJy3YGZLNaHVrjOIHrLz2QEhg-av_GYPnIhuFDlZ5RSu-GePeakWw6Zc4-lDTTuXGw May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: 0b8348f4bffd44e7b0da6367a1011709 May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-TestVolumeBootPattern-554040557 May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 17:01:49.044749 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-TestVolumeBootPattern-554040557 May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: 0b8348f4bffd44e7b0da6367a1011709 May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-TestVolumeBootPattern-554040557 May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-TestVolumeBootPattern-554040557-project May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: fe1f5f6882eb4a9aa869ad32fbdb0d92 May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-TestVolumeBootPattern-554040557-project May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 23394041-3e1c-45af-9d2d-a0c5efe417fe could not be found. May 10 17:01:49.046308 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '23394041-3e1c-45af-9d2d-a0c5efe417fe'} May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23394041-3e1c-45af-9d2d-a0c5efe417fe could not be found. May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:01:49.047167 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23394041-3e1c-45af-9d2d-a0c5efe417fe could not be found. May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23394041-3e1c-45af-9d2d-a0c5efe417fe could not be found. May 10 17:01:49.048563 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 17:01:49.049787 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-daf6d8c3-d249-490a-9975-239c773edc31 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Returning 404 to user: Instance 23394041-3e1c-45af-9d2d-a0c5efe417fe could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:01:49.049787 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-daf6d8c3-d249-490a-9975-239c773edc31 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe" status: 404 len: 111 microversion: 2.1 time: 0.031625 May 10 17:01:49.049787 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 497/1026] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:49 2022] GET /compute/v2.1/servers/23394041-3e1c-45af-9d2d-a0c5efe417fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:01:49.667706 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-89d8994b-02f5-4a86-9b34-4b268e4a335e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:49.668336 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-89d8994b-02f5-4a86-9b34-4b268e4a335e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:49.675488 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-89d8994b-02f5-4a86-9b34-4b268e4a335e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:49.675937 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-89d8994b-02f5-4a86-9b34-4b268e4a335e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:49.676744 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-89d8994b-02f5-4a86-9b34-4b268e4a335e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:49.677180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-89d8994b-02f5-4a86-9b34-4b268e4a335e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:49.818978 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-89d8994b-02f5-4a86-9b34-4b268e4a335e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:49.827210 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-89d8994b-02f5-4a86-9b34-4b268e4a335e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.163520 May 10 17:01:49.827790 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 530/1027] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:49 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:50.844773 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-e3353153-0269-4562-ae07-699b0602ada6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:50.845372 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-e3353153-0269-4562-ae07-699b0602ada6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:50.852123 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e3353153-0269-4562-ae07-699b0602ada6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:50.852597 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e3353153-0269-4562-ae07-699b0602ada6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:50.853379 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e3353153-0269-4562-ae07-699b0602ada6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:50.853803 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-e3353153-0269-4562-ae07-699b0602ada6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:50.994763 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-e3353153-0269-4562-ae07-699b0602ada6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:51.002641 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-e3353153-0269-4562-ae07-699b0602ada6 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.161961 May 10 17:01:51.003412 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 498/1028] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:50 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:51.125779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:01:51.126344 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Tue May 10 17:01:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:01:52.020125 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e0b351e2-9a92-4725-8435-42a75e008582 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:52.020686 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e0b351e2-9a92-4725-8435-42a75e008582 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:52.027167 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e0b351e2-9a92-4725-8435-42a75e008582 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:52.027621 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e0b351e2-9a92-4725-8435-42a75e008582 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:52.028440 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e0b351e2-9a92-4725-8435-42a75e008582 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:52.028883 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e0b351e2-9a92-4725-8435-42a75e008582 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:52.246870 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e0b351e2-9a92-4725-8435-42a75e008582 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:52.256814 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e0b351e2-9a92-4725-8435-42a75e008582 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.241425 May 10 17:01:52.257398 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 531/1029] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:52 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:52.282017 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-023f51d5-b495-40db-897e-6d210a0ceb33 req-43c7209e-6c23-4b38-a9fc-385b272113b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4369776b-ef35-4d80-8a7d-0d79609863c7", "tag": "08ff1226-2ba9-4c73-a826-9f811db89a93"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:01:52.288187 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-348f8b68-ffcd-446e-b4cf-72dfe53235ae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:52.288808 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-348f8b68-ffcd-446e-b4cf-72dfe53235ae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:52.296462 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-348f8b68-ffcd-446e-b4cf-72dfe53235ae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:52.297266 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-348f8b68-ffcd-446e-b4cf-72dfe53235ae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:52.297964 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-023f51d5-b495-40db-897e-6d210a0ceb33 req-43c7209e-6c23-4b38-a9fc-385b272113b9 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:52.298418 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-023f51d5-b495-40db-897e-6d210a0ceb33 req-43c7209e-6c23-4b38-a9fc-385b272113b9 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:52.298543 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-348f8b68-ffcd-446e-b4cf-72dfe53235ae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:52.299201 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-348f8b68-ffcd-446e-b4cf-72dfe53235ae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:52.311175 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-023f51d5-b495-40db-897e-6d210a0ceb33 req-43c7209e-6c23-4b38-a9fc-385b272113b9 service nova] Creating event network-changed:08ff1226-2ba9-4c73-a826-9f811db89a93 for instance 4369776b-ef35-4d80-8a7d-0d79609863c7 on hv-cinder-83588 May 10 17:01:52.317438 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-023f51d5-b495-40db-897e-6d210a0ceb33 req-43c7209e-6c23-4b38-a9fc-385b272113b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038966 May 10 17:01:52.318555 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 532/1030] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 17:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:01:52.330073 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-348f8b68-ffcd-446e-b4cf-72dfe53235ae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:01:52.430394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-348f8b68-ffcd-446e-b4cf-72dfe53235ae tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 204 len: 0 microversion: 2.1 time: 0.149676 May 10 17:01:52.430394 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 499/1031] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 17:01:52 2022] DELETE /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:01:52.436778 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-eb884b69-9278-4e73-b2be-9056a8195da3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:52.437608 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-eb884b69-9278-4e73-b2be-9056a8195da3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:52.445353 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb884b69-9278-4e73-b2be-9056a8195da3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:52.445960 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb884b69-9278-4e73-b2be-9056a8195da3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:52.446908 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb884b69-9278-4e73-b2be-9056a8195da3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:52.447463 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-eb884b69-9278-4e73-b2be-9056a8195da3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:52.618648 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-eb884b69-9278-4e73-b2be-9056a8195da3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:52.626673 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-eb884b69-9278-4e73-b2be-9056a8195da3 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1577 microversion: 2.1 time: 0.194130 May 10 17:01:52.627253 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 533/1032] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:52 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:53.285428 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b8fcd126-39fb-437a-98d6-ab4a14ac9109 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:53.286178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b8fcd126-39fb-437a-98d6-ab4a14ac9109 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:53.292844 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b8fcd126-39fb-437a-98d6-ab4a14ac9109 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:53.293501 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b8fcd126-39fb-437a-98d6-ab4a14ac9109 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:53.294083 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b8fcd126-39fb-437a-98d6-ab4a14ac9109 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:53.294574 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b8fcd126-39fb-437a-98d6-ab4a14ac9109 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:53.437783 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b8fcd126-39fb-437a-98d6-ab4a14ac9109 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:53.447911 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b8fcd126-39fb-437a-98d6-ab4a14ac9109 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.167403 May 10 17:01:53.448883 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 500/1033] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:53 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:53.645095 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3ef65b71-fa8e-4571-aecf-be479e49c066 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:53.645866 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3ef65b71-fa8e-4571-aecf-be479e49c066 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:53.652752 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3ef65b71-fa8e-4571-aecf-be479e49c066 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:53.653210 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3ef65b71-fa8e-4571-aecf-be479e49c066 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:53.653997 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3ef65b71-fa8e-4571-aecf-be479e49c066 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:53.654438 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3ef65b71-fa8e-4571-aecf-be479e49c066 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:53.882608 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3ef65b71-fa8e-4571-aecf-be479e49c066 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:53.890169 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3ef65b71-fa8e-4571-aecf-be479e49c066 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1577 microversion: 2.1 time: 0.249562 May 10 17:01:53.902685 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 534/1034] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:53 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1577 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:54.465569 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-3eb61aff-d1e7-4a92-8ec0-312fe0ce0e5b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:54.465794 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-3eb61aff-d1e7-4a92-8ec0-312fe0ce0e5b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:54.472799 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3eb61aff-d1e7-4a92-8ec0-312fe0ce0e5b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:54.473252 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3eb61aff-d1e7-4a92-8ec0-312fe0ce0e5b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:54.474032 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3eb61aff-d1e7-4a92-8ec0-312fe0ce0e5b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:54.474654 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-3eb61aff-d1e7-4a92-8ec0-312fe0ce0e5b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:54.510537 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [req-8faacbd4-90f5-4474-9a5e-fa4b921ac876 req-ec75d04f-92bc-4063-a90e-49a247addcca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4369776b-ef35-4d80-8a7d-0d79609863c7", "name": "network-vif-deleted", "tag": "08ff1226-2ba9-4c73-a826-9f811db89a93"}]} {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:01:54.519875 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-8faacbd4-90f5-4474-9a5e-fa4b921ac876 req-ec75d04f-92bc-4063-a90e-49a247addcca service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:54.520476 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [req-8faacbd4-90f5-4474-9a5e-fa4b921ac876 req-ec75d04f-92bc-4063-a90e-49a247addcca service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:54.532252 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.compute.server_external_events [req-8faacbd4-90f5-4474-9a5e-fa4b921ac876 req-ec75d04f-92bc-4063-a90e-49a247addcca service nova] Creating event network-vif-deleted:08ff1226-2ba9-4c73-a826-9f811db89a93 for instance 4369776b-ef35-4d80-8a7d-0d79609863c7 on hv-cinder-83588 May 10 17:01:54.538452 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [req-8faacbd4-90f5-4474-9a5e-fa4b921ac876 req-ec75d04f-92bc-4063-a90e-49a247addcca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127966 May 10 17:01:54.539215 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 501/1035] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 17:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:01:54.636153 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-3eb61aff-d1e7-4a92-8ec0-312fe0ce0e5b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:54.644503 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-3eb61aff-d1e7-4a92-8ec0-312fe0ce0e5b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.183238 May 10 17:01:54.645240 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 535/1036] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:54 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:01:54.910534 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-d4b5a250-2321-4e70-b7c8-bba96ab24139 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:54.911243 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-d4b5a250-2321-4e70-b7c8-bba96ab24139 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:54.917561 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d4b5a250-2321-4e70-b7c8-bba96ab24139 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:54.918018 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d4b5a250-2321-4e70-b7c8-bba96ab24139 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:54.918805 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d4b5a250-2321-4e70-b7c8-bba96ab24139 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:54.919251 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-d4b5a250-2321-4e70-b7c8-bba96ab24139 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:54.985921 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-d4b5a250-2321-4e70-b7c8-bba96ab24139 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:54.994152 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-d4b5a250-2321-4e70-b7c8-bba96ab24139 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1225 microversion: 2.1 time: 0.087898 May 10 17:01:54.994728 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 502/1037] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:54 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:01:55.670540 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e5f4802f-31ac-4973-84ef-140eda613c8f tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:55.671160 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e5f4802f-31ac-4973-84ef-140eda613c8f tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:55.686698 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e5f4802f-31ac-4973-84ef-140eda613c8f tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:55.687159 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e5f4802f-31ac-4973-84ef-140eda613c8f tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:55.687983 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e5f4802f-31ac-4973-84ef-140eda613c8f tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:55.688444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e5f4802f-31ac-4973-84ef-140eda613c8f tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:55.829723 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e5f4802f-31ac-4973-84ef-140eda613c8f tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:55.837904 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e5f4802f-31ac-4973-84ef-140eda613c8f tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.171551 May 10 17:01:55.838485 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 536/1038] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:55 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:56.010960 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:56.011585 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:56.019333 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:56.019905 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:56.020827 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:56.021373 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:56.058917 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:56.059376 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:56.059830 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lazy-loading 'fault' on Instance uuid 4369776b-ef35-4d80-8a7d-0d79609863c7 {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:01:56.108198 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1f5f6882eb4a9aa869ad32fbdb0d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b8348f4bffd44e7b0da6367a1011709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:56.116139 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-70a93c74-1644-4b36-b145-6fc46a8d23d9 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 200 len: 1184 microversion: 2.1 time: 0.109040 May 10 17:01:56.116761 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 503/1039] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:56 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 1184 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:56.691930 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-00cf36be-0637-491b-a322-559e184cdcb6 req-0caf4487-985c-4444-b4dc-fed2d30e5f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac", "name": "network-vif-unplugged", "status": "completed", "tag": "7a105162-f20d-4ee9-a4ae-56c05650a65d"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:01:56.701159 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-00cf36be-0637-491b-a322-559e184cdcb6 req-0caf4487-985c-4444-b4dc-fed2d30e5f2f service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:56.701779 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-00cf36be-0637-491b-a322-559e184cdcb6 req-0caf4487-985c-4444-b4dc-fed2d30e5f2f service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:56.713972 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.compute.server_external_events [req-00cf36be-0637-491b-a322-559e184cdcb6 req-0caf4487-985c-4444-b4dc-fed2d30e5f2f service nova] Unable to find a host for instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac. Dropping event network-vif-unplugged {{(pid=134195) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 17:01:56.714968 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-00cf36be-0637-491b-a322-559e184cdcb6 req-0caf4487-985c-4444-b4dc-fed2d30e5f2f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028275 May 10 17:01:56.715652 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 537/1040] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 17:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 17:01:56.857062 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-cab8992e-1bde-4238-a514-6975126729b8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:56.857677 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-cab8992e-1bde-4238-a514-6975126729b8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:56.864530 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cab8992e-1bde-4238-a514-6975126729b8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:56.864982 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cab8992e-1bde-4238-a514-6975126729b8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:56.865758 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cab8992e-1bde-4238-a514-6975126729b8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:56.866191 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-cab8992e-1bde-4238-a514-6975126729b8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.004301 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-cab8992e-1bde-4238-a514-6975126729b8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:57.012354 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-cab8992e-1bde-4238-a514-6975126729b8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1507 microversion: 2.1 time: 0.159185 May 10 17:01:57.013016 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 504/1041] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:56 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:57.029885 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-35879132-97e0-456a-9925-e56818540650 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:01:57.030463 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-35879132-97e0-456a-9925-e56818540650 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:57.038001 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-35879132-97e0-456a-9925-e56818540650 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:57.038460 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-35879132-97e0-456a-9925-e56818540650 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.039259 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-35879132-97e0-456a-9925-e56818540650 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:57.039700 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-35879132-97e0-456a-9925-e56818540650 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.121939 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-35879132-97e0-456a-9925-e56818540650 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "POST /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac/action" status: 202 len: 0 microversion: 2.1 time: 0.095838 May 10 17:01:57.125453 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 538/1042] 10.222.0.48 () {60 vars in 1277 bytes} [Tue May 10 17:01:57 2022] POST /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:01:57.131143 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-246696b1-da36-47fd-bcd9-5a631efde7a2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:57.132111 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-246696b1-da36-47fd-bcd9-5a631efde7a2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:57.132357 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4c020636-24e3-452d-85a8-fe0131ed92fb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:57.133268 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4c020636-24e3-452d-85a8-fe0131ed92fb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 4369776b-ef35-4d80-8a7d-0d79609863c7] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:57.139014 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-246696b1-da36-47fd-bcd9-5a631efde7a2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:57.139195 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4c020636-24e3-452d-85a8-fe0131ed92fb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:57.139505 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4c020636-24e3-452d-85a8-fe0131ed92fb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.139668 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-246696b1-da36-47fd-bcd9-5a631efde7a2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.140312 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4c020636-24e3-452d-85a8-fe0131ed92fb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:57.140683 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-246696b1-da36-47fd-bcd9-5a631efde7a2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:57.140809 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4c020636-24e3-452d-85a8-fe0131ed92fb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.141064 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-246696b1-da36-47fd-bcd9-5a631efde7a2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.156829 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-4c020636-24e3-452d-85a8-fe0131ed92fb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] HTTP exception thrown: Instance 4369776b-ef35-4d80-8a7d-0d79609863c7 could not be found. May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4c020636-24e3-452d-85a8-fe0131ed92fb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Request method failure captured: May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 HTTP/1.1 May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepjwXWkcZx8fdNuIhlagIKAe2rPPbeB7-tsPIBcLhVhRwOgv69uzq7zmpdwHxuDIbAht7CyNKaYaHfWnwzFWL6i1UfuV8qzsE6QL43t4eRPSyDJy3YGZLNaHVrjOIHrLz2QEhg-av_GYPnIhuFDlZ5RSu-GePeakWw6Zc4-lDTTuXGw May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 0b8348f4bffd44e7b0da6367a1011709 May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-TestVolumeBootPattern-554040557 May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 17:01:57.158581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-TestVolumeBootPattern-554040557 May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 0b8348f4bffd44e7b0da6367a1011709 May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-TestVolumeBootPattern-554040557 May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-TestVolumeBootPattern-554040557-project May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: fe1f5f6882eb4a9aa869ad32fbdb0d92 May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-TestVolumeBootPattern-554040557-project May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 4369776b-ef35-4d80-8a7d-0d79609863c7 could not be found. May 10 17:01:57.162145 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '4369776b-ef35-4d80-8a7d-0d79609863c7'} May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4369776b-ef35-4d80-8a7d-0d79609863c7 could not be found. May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:01:57.164638 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4369776b-ef35-4d80-8a7d-0d79609863c7 could not be found. May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4369776b-ef35-4d80-8a7d-0d79609863c7 could not be found. May 10 17:01:57.167109 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:01:57.170375 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4c020636-24e3-452d-85a8-fe0131ed92fb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Returning 404 to user: Instance 4369776b-ef35-4d80-8a7d-0d79609863c7 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:01:57.170375 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4c020636-24e3-452d-85a8-fe0131ed92fb tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7" status: 404 len: 111 microversion: 2.1 time: 0.032187 May 10 17:01:57.170375 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 539/1043] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:57 2022] GET /compute/v2.1/servers/4369776b-ef35-4d80-8a7d-0d79609863c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:01:57.340353 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-246696b1-da36-47fd-bcd9-5a631efde7a2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:57.348719 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-246696b1-da36-47fd-bcd9-5a631efde7a2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1515 microversion: 2.1 time: 0.221675 May 10 17:01:57.349372 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 505/1044] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:57 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:01:57.653346 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-76158f39-dccf-4177-b318-172f4249884d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:57.653850 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-76158f39-dccf-4177-b318-172f4249884d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:57.661406 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-76158f39-dccf-4177-b318-172f4249884d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:57.661859 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-76158f39-dccf-4177-b318-172f4249884d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.662648 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-76158f39-dccf-4177-b318-172f4249884d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:57.663087 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-76158f39-dccf-4177-b318-172f4249884d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.678111 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-76158f39-dccf-4177-b318-172f4249884d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] HTTP exception thrown: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-76158f39-dccf-4177-b318-172f4249884d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Request method failure captured: May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: DELETE /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 HTTP/1.1 May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepjwXWkcZx8fdNuIhlagIKAe2rPPbeB7-tsPIBcLhVhRwOgv69uzq7zmpdwHxuDIbAht7CyNKaYaHfWnwzFWL6i1UfuV8qzsE6QL43t4eRPSyDJy3YGZLNaHVrjOIHrLz2QEhg-av_GYPnIhuFDlZ5RSu-GePeakWw6Zc4-lDTTuXGw May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 0b8348f4bffd44e7b0da6367a1011709 May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-TestVolumeBootPattern-554040557 May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 17:01:57.679953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-TestVolumeBootPattern-554040557 May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 0b8348f4bffd44e7b0da6367a1011709 May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-TestVolumeBootPattern-554040557 May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-TestVolumeBootPattern-554040557-project May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: fe1f5f6882eb4a9aa869ad32fbdb0d92 May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-TestVolumeBootPattern-554040557-project May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 17:01:57.681693 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '00d3be1d-f8ff-4768-950e-8cc38569d771'} May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:01:57.685852 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 17:01:57.687207 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:01:57.688699 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-76158f39-dccf-4177-b318-172f4249884d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Returning 404 to user: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:01:57.688699 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-76158f39-dccf-4177-b318-172f4249884d tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "DELETE /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 404 len: 111 microversion: 2.1 time: 0.031953 May 10 17:01:57.688699 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 540/1045] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 17:01:57 2022] DELETE /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:01:57.694565 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5f4a77b1-b5c6-411b-882c-999cf65df918 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:57.695182 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-5f4a77b1-b5c6-411b-882c-999cf65df918 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] [instance: 00d3be1d-f8ff-4768-950e-8cc38569d771] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:57.701830 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5f4a77b1-b5c6-411b-882c-999cf65df918 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:57.702285 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5f4a77b1-b5c6-411b-882c-999cf65df918 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.703062 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5f4a77b1-b5c6-411b-882c-999cf65df918 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:57.703538 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-5f4a77b1-b5c6-411b-882c-999cf65df918 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:57.718472 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.wsgi [None req-5f4a77b1-b5c6-411b-882c-999cf65df918 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] HTTP exception thrown: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5f4a77b1-b5c6-411b-882c-999cf65df918 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Request method failure captured: May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: request: GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 HTTP/1.1 May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept: application/json May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Accept-Encoding: identity May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Connection: close May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Length: 0 May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Content-Type: application/json May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Host: 10.222.0.48 May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Openstack-System-Scope: None May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: User-Agent: python-urllib3/1.26.9 May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Auth-Token: gAAAAABiepjwXWkcZx8fdNuIhlagIKAe2rPPbeB7-tsPIBcLhVhRwOgv69uzq7zmpdwHxuDIbAht7CyNKaYaHfWnwzFWL6i1UfuV8qzsE6QL43t4eRPSyDJy3YGZLNaHVrjOIHrLz2QEhg-av_GYPnIhuFDlZ5RSu-GePeakWw6Zc4-lDTTuXGw May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Id: None May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Domain-Name: None May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Identity-Status: Confirmed May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Is-Admin-Project: True May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Id: default May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Domain-Name: Default May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Id: 0b8348f4bffd44e7b0da6367a1011709 May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Project-Name: tempest-TestVolumeBootPattern-554040557 May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Role: reader,member May 10 17:01:57.720134 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Roles: reader,member May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0b8348f4bffd44e7b0da6367a1011709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant: tempest-TestVolumeBootPattern-554040557 May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Id: 0b8348f4bffd44e7b0da6367a1011709 May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-Tenant-Name: tempest-TestVolumeBootPattern-554040557 May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User: tempest-TestVolumeBootPattern-554040557-project May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Id: default May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Domain-Name: Default May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Id: fe1f5f6882eb4a9aa869ad32fbdb0d92 May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: X-User-Name: tempest-TestVolumeBootPattern-554040557-project May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: method: > May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: exception: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 17:01:57.722194 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: action_args: {'id': '00d3be1d-f8ff-4768-950e-8cc38569d771'} May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:01:57.723221 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. May 10 17:01:57.725814 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: ERROR nova.api.openstack.wsgi May 10 17:01:57.728256 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-5f4a77b1-b5c6-411b-882c-999cf65df918 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Returning 404 to user: Instance 00d3be1d-f8ff-4768-950e-8cc38569d771 could not be found. {{(pid=134194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:01:57.728256 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-5f4a77b1-b5c6-411b-882c-999cf65df918 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771" status: 404 len: 111 microversion: 2.1 time: 0.041013 May 10 17:01:57.728752 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 506/1046] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:57 2022] GET /compute/v2.1/servers/00d3be1d-f8ff-4768-950e-8cc38569d771 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:01:58.371845 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9e5802c0-195d-4943-9e69-28e096a99324 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:58.372569 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9e5802c0-195d-4943-9e69-28e096a99324 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:58.379628 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9e5802c0-195d-4943-9e69-28e096a99324 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:58.380170 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9e5802c0-195d-4943-9e69-28e096a99324 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:58.380908 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9e5802c0-195d-4943-9e69-28e096a99324 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:58.381350 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9e5802c0-195d-4943-9e69-28e096a99324 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:58.528679 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9e5802c0-195d-4943-9e69-28e096a99324 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:58.538690 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9e5802c0-195d-4943-9e69-28e096a99324 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1573 microversion: 2.1 time: 0.170928 May 10 17:01:58.539719 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 541/1047] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:58 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:01:59.241610 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-27c4a5e9-ebad-451d-869a-53e988cbde98 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] Calling method '.version_select at 0x7f5fb6a8f790>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:59.270617 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-27c4a5e9-ebad-451d-869a-53e988cbde98 tempest-TestVolumeBootPattern-554040557 tempest-TestVolumeBootPattern-554040557-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-578502746" status: 202 len: 0 microversion: 2.1 time: 0.040828 May 10 17:01:59.271255 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 507/1048] 10.222.0.48 () {58 vars in 1259 bytes} [Tue May 10 17:01:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-578502746 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:01:59.560444 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-e27716e6-08f8-4e81-81e3-e648a4629915 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:01:59.561005 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-e27716e6-08f8-4e81-81e3-e648a4629915 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:01:59.567573 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e27716e6-08f8-4e81-81e3-e648a4629915 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:59.567999 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e27716e6-08f8-4e81-81e3-e648a4629915 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:59.568923 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e27716e6-08f8-4e81-81e3-e648a4629915 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:01:59.569353 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-e27716e6-08f8-4e81-81e3-e648a4629915 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:01:59.718810 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-e27716e6-08f8-4e81-81e3-e648a4629915 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:01:59.727661 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-e27716e6-08f8-4e81-81e3-e648a4629915 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1573 microversion: 2.1 time: 0.171127 May 10 17:01:59.728568 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 542/1049] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:01:59 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1573 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:02:00.745682 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-71b5e4de-e07e-4d2c-809a-a8afcd5d073e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:02:00.746336 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-71b5e4de-e07e-4d2c-809a-a8afcd5d073e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:02:00.755270 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-71b5e4de-e07e-4d2c-809a-a8afcd5d073e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:00.755733 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-71b5e4de-e07e-4d2c-809a-a8afcd5d073e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:00.757311 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-71b5e4de-e07e-4d2c-809a-a8afcd5d073e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:00.757311 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-71b5e4de-e07e-4d2c-809a-a8afcd5d073e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:00.994110 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-71b5e4de-e07e-4d2c-809a-a8afcd5d073e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:02:01.001657 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-71b5e4de-e07e-4d2c-809a-a8afcd5d073e tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1573 microversion: 2.1 time: 0.260336 May 10 17:02:01.002236 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 508/1050] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:02:00 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1573 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:02:02.021180 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4a679c0d-3450-4260-bf47-17a571ac8938 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:02:02.022754 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4a679c0d-3450-4260-bf47-17a571ac8938 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:02:02.038529 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4a679c0d-3450-4260-bf47-17a571ac8938 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:02.039075 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4a679c0d-3450-4260-bf47-17a571ac8938 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:02.042450 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4a679c0d-3450-4260-bf47-17a571ac8938 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:02.042450 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4a679c0d-3450-4260-bf47-17a571ac8938 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:02.277746 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4a679c0d-3450-4260-bf47-17a571ac8938 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:02:02.286026 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4a679c0d-3450-4260-bf47-17a571ac8938 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1573 microversion: 2.1 time: 0.270512 May 10 17:02:02.286662 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 543/1051] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:02:02 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1573 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:02:03.306583 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-a716b997-64a9-4ba7-b8c5-c27cba8328db tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:02:03.307631 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-a716b997-64a9-4ba7-b8c5-c27cba8328db tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:02:03.319725 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a716b997-64a9-4ba7-b8c5-c27cba8328db tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:03.320524 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a716b997-64a9-4ba7-b8c5-c27cba8328db tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:03.321835 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a716b997-64a9-4ba7-b8c5-c27cba8328db tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:03.326335 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-a716b997-64a9-4ba7-b8c5-c27cba8328db tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:03.600156 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-a716b997-64a9-4ba7-b8c5-c27cba8328db tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:02:03.607758 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-a716b997-64a9-4ba7-b8c5-c27cba8328db tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1573 microversion: 2.1 time: 0.307229 May 10 17:02:03.608387 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 509/1052] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:02:03 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1573 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:02:04.625182 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-9cdd69af-b717-4d1c-a048-df03dbeb1bc2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:02:04.625894 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-9cdd69af-b717-4d1c-a048-df03dbeb1bc2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:02:04.632965 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9cdd69af-b717-4d1c-a048-df03dbeb1bc2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:04.633503 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9cdd69af-b717-4d1c-a048-df03dbeb1bc2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:04.634375 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9cdd69af-b717-4d1c-a048-df03dbeb1bc2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:04.634873 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-9cdd69af-b717-4d1c-a048-df03dbeb1bc2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:04.783568 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-9cdd69af-b717-4d1c-a048-df03dbeb1bc2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:02:04.791737 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-9cdd69af-b717-4d1c-a048-df03dbeb1bc2 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1573 microversion: 2.1 time: 0.170892 May 10 17:02:04.792342 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 544/1053] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:02:04 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:02:05.810126 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-39ca047c-9bcc-4a2a-bc3a-3394eb9ccc79 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:02:05.810740 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-39ca047c-9bcc-4a2a-bc3a-3394eb9ccc79 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:02:05.818675 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-39ca047c-9bcc-4a2a-bc3a-3394eb9ccc79 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:05.819123 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-39ca047c-9bcc-4a2a-bc3a-3394eb9ccc79 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:05.820115 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-39ca047c-9bcc-4a2a-bc3a-3394eb9ccc79 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:05.820727 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-39ca047c-9bcc-4a2a-bc3a-3394eb9ccc79 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:06.024769 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-39ca047c-9bcc-4a2a-bc3a-3394eb9ccc79 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:02:06.033561 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-39ca047c-9bcc-4a2a-bc3a-3394eb9ccc79 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1573 microversion: 2.1 time: 0.227255 May 10 17:02:06.035053 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 510/1054] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:02:05 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1573 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:02:07.052697 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-83c98ce1-cb55-4410-94e8-699cd5d4974b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:02:07.055967 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-83c98ce1-cb55-4410-94e8-699cd5d4974b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:02:07.063681 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-83c98ce1-cb55-4410-94e8-699cd5d4974b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:07.064605 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-83c98ce1-cb55-4410-94e8-699cd5d4974b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:07.066730 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-83c98ce1-cb55-4410-94e8-699cd5d4974b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:07.067243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-83c98ce1-cb55-4410-94e8-699cd5d4974b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:07.225910 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-83c98ce1-cb55-4410-94e8-699cd5d4974b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:02:07.234383 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-83c98ce1-cb55-4410-94e8-699cd5d4974b tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1573 microversion: 2.1 time: 0.186794 May 10 17:02:07.235236 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 545/1055] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:02:07 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1573 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:02:08.252232 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-bb1a6556-5ca4-4517-b255-8b98578cf1de tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:02:08.253426 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-bb1a6556-5ca4-4517-b255-8b98578cf1de tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:02:08.260206 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb1a6556-5ca4-4517-b255-8b98578cf1de tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:08.260699 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb1a6556-5ca4-4517-b255-8b98578cf1de tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:08.261501 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb1a6556-5ca4-4517-b255-8b98578cf1de tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:08.261955 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-bb1a6556-5ca4-4517-b255-8b98578cf1de tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:08.398853 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-bb1a6556-5ca4-4517-b255-8b98578cf1de tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:02:08.406253 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-bb1a6556-5ca4-4517-b255-8b98578cf1de tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1573 microversion: 2.1 time: 0.158018 May 10 17:02:08.406818 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 511/1056] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:02:08 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:02:08.754346 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-9ac85670-c1e1-4307-aa8b-d6017208fec7 req-13c012a7-af42-4172-86cf-c26fa3ed043b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac", "name": "network-vif-plugged", "status": "completed", "tag": "7a105162-f20d-4ee9-a4ae-56c05650a65d"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:02:08.764143 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-9ac85670-c1e1-4307-aa8b-d6017208fec7 req-13c012a7-af42-4172-86cf-c26fa3ed043b service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:08.764628 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-9ac85670-c1e1-4307-aa8b-d6017208fec7 req-13c012a7-af42-4172-86cf-c26fa3ed043b service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:08.778741 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-9ac85670-c1e1-4307-aa8b-d6017208fec7 req-13c012a7-af42-4172-86cf-c26fa3ed043b service nova] Creating event network-vif-plugged:7a105162-f20d-4ee9-a4ae-56c05650a65d for instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac on hv-cinder-83588 May 10 17:02:08.785396 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-9ac85670-c1e1-4307-aa8b-d6017208fec7 req-13c012a7-af42-4172-86cf-c26fa3ed043b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033926 May 10 17:02:08.786178 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 546/1057] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 17:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:02:09.423645 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-2d14416f-6c92-467c-be4e-6357e5abffd5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:02:09.424866 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-2d14416f-6c92-467c-be4e-6357e5abffd5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:02:09.431343 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d14416f-6c92-467c-be4e-6357e5abffd5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:09.431798 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d14416f-6c92-467c-be4e-6357e5abffd5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:09.432599 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d14416f-6c92-467c-be4e-6357e5abffd5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:09.433068 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-2d14416f-6c92-467c-be4e-6357e5abffd5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:09.568483 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-2d14416f-6c92-467c-be4e-6357e5abffd5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:02:09.576002 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-2d14416f-6c92-467c-be4e-6357e5abffd5 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1573 microversion: 2.1 time: 0.156250 May 10 17:02:09.576607 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 512/1058] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:02:09 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:02:10.593844 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-43244a52-ed00-4414-8a27-9633ffe7db25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:02:10.594537 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-43244a52-ed00-4414-8a27-9633ffe7db25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:02:10.601124 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-43244a52-ed00-4414-8a27-9633ffe7db25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:10.601572 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-43244a52-ed00-4414-8a27-9633ffe7db25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:10.602337 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-43244a52-ed00-4414-8a27-9633ffe7db25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:02:10.602768 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-43244a52-ed00-4414-8a27-9633ffe7db25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:02:10.736690 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-43244a52-ed00-4414-8a27-9633ffe7db25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:02:10.744816 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-43244a52-ed00-4414-8a27-9633ffe7db25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1560 microversion: 2.1 time: 0.155151 May 10 17:02:10.745392 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 547/1059] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:02:10 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:03:07.896737 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:03:07.897364 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Tue May 10 17:03:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:03:17.868186 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:03:17.868839 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Tue May 10 17:03:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:03:27.296474 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-855dc4d8-7c7b-41f9-a91c-845aa79b06f8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:03:27.297066 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-855dc4d8-7c7b-41f9-a91c-845aa79b06f8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:03:27.299715 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-b276e437-b531-4733-951d-50505f751dfe req-1d7707bc-7b59-4624-90dd-457bcfc23a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac", "tag": "7a105162-f20d-4ee9-a4ae-56c05650a65d"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:03:27.304206 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-855dc4d8-7c7b-41f9-a91c-845aa79b06f8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:27.304674 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-855dc4d8-7c7b-41f9-a91c-845aa79b06f8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:27.305958 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-855dc4d8-7c7b-41f9-a91c-845aa79b06f8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:27.306636 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-855dc4d8-7c7b-41f9-a91c-845aa79b06f8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:27.309819 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-b276e437-b531-4733-951d-50505f751dfe req-1d7707bc-7b59-4624-90dd-457bcfc23a25 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:27.310264 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-b276e437-b531-4733-951d-50505f751dfe req-1d7707bc-7b59-4624-90dd-457bcfc23a25 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:27.323202 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-b276e437-b531-4733-951d-50505f751dfe req-1d7707bc-7b59-4624-90dd-457bcfc23a25 service nova] Creating event network-changed:7a105162-f20d-4ee9-a4ae-56c05650a65d for instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac on hv-cinder-83588 May 10 17:03:27.329052 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-b276e437-b531-4733-951d-50505f751dfe req-1d7707bc-7b59-4624-90dd-457bcfc23a25 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034900 May 10 17:03:27.329972 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 548/1060] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 17:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:03:27.342913 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-855dc4d8-7c7b-41f9-a91c-845aa79b06f8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Going to try to terminate instance {{(pid=134194) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:03:27.447329 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-855dc4d8-7c7b-41f9-a91c-845aa79b06f8 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "DELETE /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 204 len: 0 microversion: 2.1 time: 0.156458 May 10 17:03:27.448430 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 513/1061] 10.222.0.48 () {58 vars in 1238 bytes} [Tue May 10 17:03:27 2022] DELETE /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:03:27.458893 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-4aa616cb-3987-4a88-ad26-13440e759bc7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:03:27.459741 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-4aa616cb-3987-4a88-ad26-13440e759bc7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:03:27.466806 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4aa616cb-3987-4a88-ad26-13440e759bc7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:27.467319 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4aa616cb-3987-4a88-ad26-13440e759bc7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:27.468116 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4aa616cb-3987-4a88-ad26-13440e759bc7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:27.468600 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-4aa616cb-3987-4a88-ad26-13440e759bc7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:27.875534 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.policy [None req-4aa616cb-3987-4a88-ad26-13440e759bc7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134195) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:03:27.884936 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-4aa616cb-3987-4a88-ad26-13440e759bc7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.431647 May 10 17:03:27.885541 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 549/1062] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:03:27 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:03:28.902827 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-b3d61863-9a27-469a-a662-2b3f24e21bf7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:03:28.903683 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-b3d61863-9a27-469a-a662-2b3f24e21bf7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:03:28.910543 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3d61863-9a27-469a-a662-2b3f24e21bf7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:28.912017 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3d61863-9a27-469a-a662-2b3f24e21bf7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:28.913140 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3d61863-9a27-469a-a662-2b3f24e21bf7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:28.913656 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-b3d61863-9a27-469a-a662-2b3f24e21bf7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:29.220350 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-b3d61863-9a27-469a-a662-2b3f24e21bf7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:03:29.228253 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-b3d61863-9a27-469a-a662-2b3f24e21bf7 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1566 microversion: 2.1 time: 0.329559 May 10 17:03:29.228888 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 514/1063] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:03:28 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1566 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:03:29.518986 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [req-58bd5374-770c-4292-bffe-532f26277204 req-f7d3a459-6a15-4d00-a8df-11da2e3c2a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac", "name": "network-vif-deleted", "tag": "7a105162-f20d-4ee9-a4ae-56c05650a65d"}]} {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:03:29.529050 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-58bd5374-770c-4292-bffe-532f26277204 req-f7d3a459-6a15-4d00-a8df-11da2e3c2a40 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:29.529706 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [req-58bd5374-770c-4292-bffe-532f26277204 req-f7d3a459-6a15-4d00-a8df-11da2e3c2a40 service nova] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:29.542590 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.compute.server_external_events [req-58bd5374-770c-4292-bffe-532f26277204 req-f7d3a459-6a15-4d00-a8df-11da2e3c2a40 service nova] Creating event network-vif-deleted:7a105162-f20d-4ee9-a4ae-56c05650a65d for instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac on hv-cinder-83588 May 10 17:03:29.548068 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [req-58bd5374-770c-4292-bffe-532f26277204 req-f7d3a459-6a15-4d00-a8df-11da2e3c2a40 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032739 May 10 17:03:29.548925 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 550/1064] 10.222.0.48 () {64 vars in 1317 bytes} [Tue May 10 17:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:03:30.246176 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:03:30.246801 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.compute.api [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134194) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:03:30.258507 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:30.258968 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:30.259830 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:30.260311 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:30.299666 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:30.300121 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG oslo_concurrency.lockutils [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:30.300607 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.objects.instance [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lazy-loading 'fault' on Instance uuid 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac {{(pid=134194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:03:30.349477 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.policy [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fafb32dcef84cc7be2399905c2611c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca9807e934c4826bb948e391d7a315a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134194) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:03:30.356737 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-f6220cfe-2fd5-4c46-bc4b-828b16a10f67 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 200 len: 1178 microversion: 2.1 time: 0.114536 May 10 17:03:30.357317 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 515/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:03:30 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 1178 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:03:31.374762 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-61c2bfd5-a9b4-4e48-9f56-8b19639eea25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '>' {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:03:31.375455 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.compute.api [None req-61c2bfd5-a9b4-4e48-9f56-8b19639eea25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] [instance: 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac] Fetching instance by UUID {{(pid=134195) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:03:31.382856 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-61c2bfd5-a9b4-4e48-9f56-8b19639eea25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:31.383303 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-61c2bfd5-a9b4-4e48-9f56-8b19639eea25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:31.384078 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-61c2bfd5-a9b4-4e48-9f56-8b19639eea25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:03:31.384554 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG oslo_concurrency.lockutils [None req-61c2bfd5-a9b4-4e48-9f56-8b19639eea25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Lock "4e87edd6-9f68-4d34-8025-7f45c9cb24ad" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:03:31.398259 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.wsgi [None req-61c2bfd5-a9b4-4e48-9f56-8b19639eea25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] HTTP exception thrown: Instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac could not be found. May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-61c2bfd5-a9b4-4e48-9f56-8b19639eea25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Request method failure captured: May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: request: GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac HTTP/1.1 May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept: application/json May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Accept-Encoding: identity May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Connection: close May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Length: 0 May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Content-Type: application/json May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Host: 10.222.0.48 May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Openstack-System-Scope: None May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: User-Agent: python-urllib3/1.26.9 May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Auth-Token: gAAAAABiepnbV2kCPqJ7YkiMrg3KTJrDbvTyKxSsozJr5cUQX4YhQHhnyd4AUeAS6C5QVIoKQD2a2MEqXHsRDepadcF8eMXbvs94C_CJFp2poszXGhBB-PF6tSPQb3ZA-6PipwZjuaKJR4J-C7ogHwqTyDUw1IVYApqyiZ40zfezaJQdyMkKgZE May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Id: None May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Domain-Name: None May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Identity-Status: Confirmed May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Is-Admin-Project: True May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Id: default May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Domain-Name: Default May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Id: 4ca9807e934c4826bb948e391d7a315a May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Project-Name: tempest-TestShelveInstance-1313662833 May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Role: reader,member May 10 17:03:31.399938 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Roles: reader,member May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4ca9807e934c4826bb948e391d7a315a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4ca9807e934c4826bb948e391d7a315a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4ca9807e934c4826bb948e391d7a315a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4ca9807e934c4826bb948e391d7a315a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant: tempest-TestShelveInstance-1313662833 May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Id: 4ca9807e934c4826bb948e391d7a315a May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-Tenant-Name: tempest-TestShelveInstance-1313662833 May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User: tempest-TestShelveInstance-1313662833-project May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Id: default May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Domain-Name: Default May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Id: 5fafb32dcef84cc7be2399905c2611c1 May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: X-User-Name: tempest-TestShelveInstance-1313662833-project May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: method: > May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: exception: Instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac could not be found. May 10 17:03:31.401581 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: action_args: {'id': '77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac'} May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: {{(pid=134195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac could not be found. May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:03:31.402523 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac could not be found. May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac could not be found. May 10 17:03:31.404243 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: ERROR nova.api.openstack.wsgi May 10 17:03:31.405953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: DEBUG nova.api.openstack.wsgi [None req-61c2bfd5-a9b4-4e48-9f56-8b19639eea25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Returning 404 to user: Instance 77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac could not be found. {{(pid=134195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:03:31.405953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO nova.api.openstack.requestlog [None req-61c2bfd5-a9b4-4e48-9f56-8b19639eea25 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac" status: 404 len: 111 microversion: 2.1 time: 0.031022 May 10 17:03:31.405953 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: [pid: 134195|app: 0|req: 551/1066] 10.222.0.48 () {58 vars in 1235 bytes} [Tue May 10 17:03:31 2022] GET /compute/v2.1/servers/77740f44-ab1a-4e3e-96fe-cadf0ec6a3ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:03:31.566023 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: DEBUG nova.api.openstack.wsgi [None req-65a8afac-b2bd-4fc2-8336-b1f12bca9af9 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] Calling method '.version_select at 0x7f5fb6b60af0>' {{(pid=134194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:03:31.588605 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO nova.api.openstack.requestlog [None req-65a8afac-b2bd-4fc2-8336-b1f12bca9af9 tempest-TestShelveInstance-1313662833 tempest-TestShelveInstance-1313662833-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1856568238" status: 202 len: 0 microversion: 2.1 time: 0.027159 May 10 17:03:31.589495 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: [pid: 134194|app: 0|req: 516/1067] 10.222.0.48 () {58 vars in 1253 bytes} [Tue May 10 17:03:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1856568238 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:05:11.134657 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:05:11.135452 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Tue May 10 17:05:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:06:27.905747 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:06:27.906333 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Tue May 10 17:06:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:06:34.346388 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:06:34.347064 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Tue May 10 17:06:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:06:37.879205 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:06:37.879775 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Tue May 10 17:06:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:06:46.222738 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:06:46.223409 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Tue May 10 17:06:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:08:31.143483 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:08:31.144087 dv-cinder-835881-10-iscsi devstack@n-api.service[134195]: Tue May 10 17:08:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:08:34.156178 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:08:34.156848 dv-cinder-835881-10-iscsi devstack@n-api.service[134194]: Tue May 10 17:08:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!